Question

Image Captioning Questions

Let’s look at the images with their captions in Figure 1. For each image in Figure 1, 3 captions are given. During training, each caption along with it’s corresponding image is given to the model as a single training example. This means that the model will see the same image with multiple different captions during training. Examining these image-caption pairs, answer the following questions:
1. What is the reasoning behind having multiple reference captions per image? What is 1 advantage and 1 disadvantage from having multiple reference captions where each caption describes the image in a different way?
2. In images C and D, the names of the entities in the photos are missing from the captions. In general, what is one reason that it might be difficult to generate descriptions that incorporate the correct names? (Hint: Think about Zipf’s Law.)

51 Caption 1) the old woman is feeding the birds in the street. A 2) a person who is sitting on a bench with pigeons around them. 3) a courtyard of poles, pigeons, and garbage cans, also has benches on either side of it, one of which shows the back of a large person facing in the direction of the pigeons. 1) the sign states no swimming, water skiing or diving. B2) a sail boat traveling over a body of water. 3) the sign is posted on the beach for everyone to see I) a baseball player walking to his post with his bat. C 2) a crowd watches on at a baseball game 3) a man walking across a field holding a baseball bat. 1) a number of people standing near one another wearing suits and ties. D 2) a group of presidents standing next to each other. 3) our past five presidents are represented in this photograph. Figure 1: Image captioning examples

Answer 1

Caption :   A caption is an explanatory text that you put close to your images. While a picture is worth a thousand words, sometimes we need a few words to magnify its effect. Captions for photos can summarise what is in the photograph or tie it to your story.

A :Why we need caption or multiple captions

It Is important to have caption to your blog or images for several reasons. Some of those are

1 It's in prime real estate.

2 Captions are scannable.

3 Captions connects texts and photos.

4 It helps to make more sense of a photo.

5 It helps search engine optimization. (seo)

Consider in image galleries

generally it is not possible to save the caption of an image without changing the caption in all other occurrences of the same image in other galleries as well.

The caption is stored in the image data. The only way to achieve what you require is to use multiple copies of the image and change the image data on each machine.

The disadvantage of having multiple captions may lead to confusion in selecting and may leads to lot of duplicate data or images will be placed.

B:

It is because of lack of image or product description, lack of reviews, non unique titles, not optimizing product pages based on the search demand,lack of speaking urls,a lot of duplicate content .

For that we hypothesize that conforming to Zipf's laws is a necessary property of a good image discription code.