Mom's Olive Oil Appetizer