レスポンスとしてどんな情報が返ってくるか?
実際にどんな情報が Vision API から返って来るのか?
ということで自分が普段 SNS 等のアイコンに使用している下記の愛犬の画像を Vision API に投げてみました。
{
"responses": [
{
"labelAnnotations": [
{
"mid": "/m/068hy",
"description": "pet",
"score": 0.98951507
},
{
"mid": "/m/0bt9lr",
"description": "dog",
"score": 0.98687589
},
{
"mid": "/m/04rky",
"description": "mammal",
"score": 0.9618566
},
{
"mid": "/m/0jbk",
"description": "animal",
"score": 0.95587397
},
{
"mid": "/m/02cyl6",
"description": "maltese",
"score": 0.89896905
},
{
"mid": "/m/09686",
"description": "vertebrate",
"score": 0.89741188
},
{
"mid": "/m/01lrl",
"description": "carnivoran",
"score": 0.85160905
},
{
"mid": "/m/0kpmf",
"description": "dog breed",
"score": 0.77777779
},
{
"mid": "/m/036hyn",
"description": "toy dog",
"score": 0.7
},
{
"mid": "/m/0b26w3",
"description": "schnoodle",
"score": 0.68533921
}
],
"imagePropertiesAnnotation": {
"dominantColors": {
"colors": [
{
"color": {
"red": 197,
"green": 199,
"blue": 195
},
"score": 0.53806108,
"pixelFraction": 0.33916494
},
{
"color": {
"red": 86,
"green": 84,
"blue": 82
},
"score": 0.030347142,
"pixelFraction": 0.046761185
},
{
"color": {
"red": 220,
"green": 230,
"blue": 229
},
"score": 0.31318155,
"pixelFraction": 0.19654006
},
{
"color": {
"red": 165,
"green": 162,
"blue": 158
},
"score": 0.047778718,
"pixelFraction": 0.19640999
},
{
"color": {
"red": 53,
"green": 55,
"blue": 55
},
"score": 0.021588614,
"pixelFraction": 0.016324142
},
{
"color": {
"red": 123,
"green": 116,
"blue": 115
},
"score": 0.017005477,
"pixelFraction": 0.10022113
},
{
"color": {
"red": 63,
"green": 92,
"blue": 77
},
"score": 0.009515699,
"pixelFraction": 0.012291883
},
{
"color": {
"red": 25,
"green": 28,
"blue": 29
},
"score": 0.0089049507,
"pixelFraction": 0.0029916754
},
{
"color": {
"red": 35,
"green": 56,
"blue": 49
},
"score": 0.0033917534,
"pixelFraction": 0.0018210198
},
{
"color": {
"red": 89,
"green": 121,
"blue": 105
},
"score": 0.0033548647,
"pixelFraction": 0.017364724
}
]
}
}
}
]
}
物体検知の結果は pet, dog, mammal, animal, maltese... 等が返ってきた。
dog だけではなく maltese といった感じで正確な犬種まで返って来るのには驚くばかりだ。
次に色検知だが RGB だとわかりづらいので下記のようにしてみた。
⬛︎⬛︎⬛︎⬛︎⬛︎
全体的に白いのでまぁこんな感じかぁ