[ { "scene": "abc_130k_01_dual_arm_robotic", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 10 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a crumpled pink cloth? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. At any point, does the cloth move while no gripper is touching it?\n3. At any point, does the cloth move while no gripper is closed on it?\n4. In the first frame, is a crumpled pink cloth in the top right corner of the white table, sitting partly inside a white basket?\n5. In the first frame, do two white robot arms with black grippers stand at the front of the table, one on the left and one on the right?\n6. Does the right arm reach into the corner, grip the crumpled cloth and drag it to the middle of the table?\n7. Do both grippers grab two corners and lift the cloth off the table, so it hangs stretched between them?\n8. Do the arms lay the cloth back down flat and then fold it over on itself several times?\n9. In the final frame, is there only one pink cloth on the table, folded into a small square bundle?\n10. In the final frame, are both grippers pulled back, with neither of them touching the folded cloth?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "abc_130k_02_robot_arm_uses", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a pink litter tray filled with sand? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. At any point, do the sand or the clumps move where the scoop has not pushed or lifted them?\n3. In the first frame, is a pink litter tray with a green inside sitting on a white table, filled with sand?\n4. In the first frame, is a black scoop held by the right robot arm?\n5. Does the arm drag the scoop through the sand and lift it so the loose sand falls through the slots, leaving only the clumps on it?\n6. Does the arm carry the scoop over the bin and tip the clumps into the trashcan?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "abc_130k_04_dual_arm_robot", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 3 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like an unfolded cardboard box? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. In the first frame, is an unfolded cardboard box lying on a table?\n3. In the final frame, is the cardboard folded into an open box with the walls standing up and the cover panel not closed onto it?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "abc_130k_05_dual_robotic_arms", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a robot arm or a cloth on a table? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the cloth crease and drape as it is pulled, rather than sliding as one stiff sheet?\n3. In the first frame, is a beige cloth folded into a narrow strip lying on a white speckled table?\n4. In the first frame, is a metal tray or any tool visible beside the folded cloth?\n5. In the first frame, are there two white robot arms with black grippers, one on the left and one on the right?\n6. In the final frame, is the cloth unfolded into one flat square sheet, with no flaps folded back on top of it?\n7. In the final frame, does the tray sit in the top half of the cloth, closer to the far edge than the near one?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "abc_130k_06_dual_robot_grippers", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a light blue plastic bag? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the fruit poke through the bag at any point?\n3. In the first frame, is a light blue plastic bag gripped by two robotic grippers?\n4. In the first frame, is there a white basket with some objects in it on the left of the table?\n5. Do the grippers pull the mouth of the bag upwards so the bag opens up and stands on the table with the fruit in it?\n6. In the final frame, are two colour patches visible through the thin bag, a yellow one on the left and a pink one on the right?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "agi_bot_world_02_dual_arm_robot", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 11 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a robot gripper? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the big book move at any point while the right gripper is not holding it, instead of just leaning there?\n3. Do the books on the shelf move at any point without the left gripper pushing them?\n4. Do the hands pass through the books at any point?\n5. In the first frame, are there two black robot grippers in the frame, with the right one holding a book?\n6. In the first frame, are a small green Christmas tree and a white pot with dried flowers on the left of the middle shelf?\n7. In the first frame, does a red toy car sit on the right side of the middle shelf?\n8. Does the left gripper push books on the shelf away to make space for the black book in the right gripper?\n9. Does the right gripper lift the book up onto the top shelf and push it into the row, turning it so the spine faces the camera?\n10. In the final frame, is either of the grippers touching anything?\n11. In the final frame, is the black book standing in the row of books on the top shelf with its spine facing out?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "agi_bot_world_04_dual_arm_robot", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 9 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a stainless steel sink with a faucet? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the water start running before the right gripper reaches the faucet lever?\n3. Does the glass move at any point while the left gripper fingers are not closed around it?\n4. In the first frame, is there a stainless steel sink in the middle with two robot arms coming in from the bottom left and bottom right?\n5. In the first frame, are three green plastic bottles standing on the counter right of the faucet, and a glass cup standing far left next to a folded salmon coloured cloth?\n6. Does the left arm reach over to the left counter, grip the glass and pour the liquid inside it into the sink?\n7. In the final frame, is the left gripper holding the glass cup below the faucet?\n8. In the final frame, is the glass filled with water about two thirds up?\n9. In the final frame, is the right hand touching anything?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "aloha_unleashed_01_tying_shoelace_bow", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 8 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a laced shoe on a cardboard box? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Do the laces pass through the cardboard box or the robotic grippers at any point?\n3. Does the knot appear without being formed by the movement of the grippers?\n4. In the first frame, is a shoe with its heel facing the camera sitting on top of a cardboard box?\n5. In the first frame, do the laces of the shoe lie over the sides of the cardboard box without passing through it?\n6. Do two robot grippers grab different laces and tie them into a knot?\n7. In the final frame, are the laces of the shoe tied into a knot, with the free ends sloping over the sides of the cardboard box without passing through it?\n8. In the final frame, are the free ends of the laces straight?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "internet_01_purple_granular_sand", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 8 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a glass hourglass with purple sand? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. In the final frame, does the mound of sand pass through any part of the lower glass bulb?\n3. Does the sand stay inside the glass and never pass through it?\n4. In the first frame, does a glass sand clock hold purple sand in the top half and a smaller pile in the bottom half?\n5. In the first frame, is the surface of the top sand pile tilted, higher at the right side?\n6. Do the fine granular sand particles pour from the top level into the bottom level and pile up on the bottom?\n7. As more sand pours, does the level of the sand in the top container level out flat?\n8. In the final frame, is all of the sand in the bottom part of the sand watch, with none left in the top part?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "internet_06_extruding_piping_pink", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a white piping bag with a metal nozzle? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. At any point, does the frosting grow or move while the nozzle is not on it?\n3. In the first frame, is only a small pink blob of frosting under the nozzle, with the rest of the cupcake top bare cake?\n4. Does pink frosting come out of the nozzle onto the middle cupcake so the pile grows, and does the nozzle then pull straight up off the pile and leave a pointed tip?\n5. In the final frame, does the middle cupcake have a tall pink swirl ending in a sharp point on top?\n6. In the final frame, is the swirl made of three stacked rings that get smaller towards the top?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "internet_07_spreading_viscous_chocolate", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a wooden board with toast slices? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. At any point, does the chocolate spread move without the knife moving it?\n3. In the first frame, are four toasts sitting in a 2x2 grid on the board?\n4. In the first frame, is there a lump of chocolate spread on top of the bottom left toast, with a knife touching it?\n5. Does the knife spread the chocolate lump over the bread by sliding across the bread in different directions?\n6. In the final frame, has the chocolate spread been spread over the bottom left toast?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "internet_08_coffee_beans_falling", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 8 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a metal grinder bowl with coffee beans? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Do the beans keep their shape when they land, and do the ones already lying there keep theirs?\n3. In the first frame, looking down into a round metal grinder bowl, is a shallow layer of brown roasted coffee beans lying on the bottom?\n4. In the first frame, does a metal blade with a round black hub sit in the middle, with a few beans blurred in mid fall above the pile?\n5. Do coffee beans keep dropping in from above and landing on the pile, colliding with beans already there, so the bean level rises through the clip?\n6. At any point, does the metal blade turn or shift while the beans land on it?\n7. In the final frame, is the bowl fuller than in the first frame, with the bottom mostly covered and the beans packed and stacked over each other?\n8. In the final frame, are only the black hub and the two flat metal blade arms still uncovered?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "internet_09_soccer_ball_thrown", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a pool filled with light blue water? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. After the impact, does the ball stay on top of the water, never sinking under the surface?\n3. In the first frame, does the light blue water of a pool fill the frame, with the far side edge of the pool not visible?\n4. In the first frame, is there a ball anywhere in the water?\n5. Does the ball drop into the frame from the top and fall into the pool, throwing up a spray of droplets where it hits the water?\n6. After the ball hits the water, does it keep moving away from the camera across the pool while spinning the whole time?\n7. In the final frame, is the only ball a red yellow white and blue soccer ball sitting on the water near the right rim of the pool, still round and not dented?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "internet_11_fabric_flag_flapping", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a striped flag with a blue star corner? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. At any point, does anything other than the cloth move, or does the flag cross over the white pole or pass through its own folds?\n3. In the first frame, is the striped end of the flag stretched out to the left and running off the left edge of the frame, with the blue star corner up at the pole?\n4. In the first frame, is the right edge of the flag held by two metal clips on a rope, hanging clear of the white pole with sky in between?\n5. Does the flag flap the whole clip, with the folds starting at the clipped right edge and running out to the striped left end, which whips and rolls over?\n6. In the final frame, has the flag pulled back in from the left edge of the frame, with the striped end inside the frame and rolled over on itself?\n7. In the final frame, is the cloth bunched into rounded folds of different sizes, with no sharp creases anywhere?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "internet_12_straight_rigid_rod", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a black rod in a gray clock frame? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the rod stay dead straight the whole time, without bending to follow the curve of the slots it rides in?\n3. At any point, does the rod collide with any other object?\n4. In the first frame, does a thin flat black rod sit in the curved slots of a gray x shaped clock frame on a dark wood table, top end up in the left hook next to the 2 and bottom end down by the 3?\n5. Does the rod slide along the curved slots and rotate around at an angle with the platform?\n6. In the final frame, is the rod almost upright with both ends sticking out, the top tip up in the open gap between the 1 and the 7 and the bottom tip just right of the 9?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "internet_14_heavy_bowling_ball", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a blue marbled bowling ball? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. In the first frame, is a blue marbled bowling ball on the wooden lane close to the camera, blurry and cut off by the bottom edge of the frame?\n3. In the first frame, are the white pins at the far end of the lane all standing upright, with none of them tipped?\n4. Does the blue ball roll away from the camera into the pins and hit just left of the front pin, so the struck pins tip over to the right and take the neighbouring pins down with them?\n5. Does the stop bar swing over from the top?\n6. In the final frame, has the stop sign moved in front of the pins?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "internet_15_dry_rice_grains", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a glass jar? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Do grains landing on top slide down the sides of the mound and settle, with the pile keeping its sloped sides instead of flattening out?\n3. In the first frame, are three glass jars of rice with measuring lines standing side by side on a wooden table, each closed with a ribbed metal lid?\n4. In the first frame, is a stream of white rice grains falling down the gap between the left and middle jar onto a low flat pile with loose scattered grains?\n5. Do the grains keep pouring down in the same spot for the whole clip while the pile grows taller and wider as they land?\n6. In the final frame, has the pile under the stream grown into a tall mound with a rounded top, spread wider over the boards, with rice still falling into it?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "internet_17_oscillating_tapping_handheld", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 9 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a round metal sieve full of flour? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does flour come out only while the sieve is shaken, with the cone keeping the same slope as it grows instead of slumping out flat?\n3. In the first frame, does a hand hold a round metal sieve with a wooden handle above a white bowl with a dark blue rim?\n4. In the first frame, is the sieve full of lumpy coarse flour, with a low flour mound already under it in the bowl?\n5. In the first frame, is the peak of the flour mound sharp?\n6. Does the hand shake the sieve side to side above the bowl so fine flour falls through the mesh in a curtain onto the pile, which keeps growing into a cone?\n7. Does the flour fall onto the mound below it at an angle as the sieve is moved left to right?\n8. In the final frame, is the sieve nearly empty, with only a thin dark patch of coarse bits left on the mesh?\n9. In the final frame, is there one flour cone in the bowl with a single peak, much taller than at the start but not too sharp?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "internet_18_thin_sheet_dough", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 5 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a pale dough sheet draped over a stick? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the dough unroll only where the stick passes, while the part already on the plate stays flat and does not slide?\n3. In the first frame, is a thin pale dough sheet half draped over a wooden stick and half already lying flat on a round dark metal plate?\n4. In the final frame, does one single dough sheet cover the plate, with no wooden stick in the frame anymore?\n5. In the final frame, is the sheet one connected piece with wrinkle lines running over it, and white smoke coming off the top left edge?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "internet_19_fabric_laundry_tumbles", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 8 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a washing machine drum full of blue towels? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Do the towels move only because the drum carries them, while the white load in the left machine that is not turning stays in the same spot from start to end?\n3. Does the cloth pass through the drum, the door, or other cloth?\n4. In the first frame, behind the middle glass door, are the blue towels piled up in the left half of the drum, with the upper right of the window dark and empty?\n5. In the first frame, is the machine on the left loaded with white laundry rather than blue?\n6. Does the blue laundry in the middle and right drums tumble the whole clip, with single towels carried up, falling back down and sliding over each other instead of moving as one solid block?\n7. Does the cloth fold and wrinkle into different sizes of folds?\n8. In the final frame, in the middle drum, is a pale light blue towel bunched up at the bottom left of the window with a long darker blue sheet draped across the middle?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "internet_20_red_shovel_cuts", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 8 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a red shovel blade in the snow? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the snow stay one packed lump on the blade and break off behind as a rough stump, instead of pouring like loose grains?\n3. Does any snow move before the shovel reaches it?\n4. In the first frame, is a red shovel blade with a metal strip along its front edge sitting empty in the snow at the right edge?\n5. In the first frame, does one raised snow block sit just left of the blade, with uneven snow around it and a dark green hedge behind?\n6. Does the blade push forward into the snow and carry one block up to the left, shedding it at the top of the frame before swinging back down empty to the right?\n7. In the final frame, is the red blade back at the right edge of the frame, tilted and empty with no snow on it?\n8. In the final frame, is the one raised snow block gone, with the snow where it stood left lower and lumpy and nothing standing there?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "internet_21_green_plastic_toy", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a green plastic shovel? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. In the first frame, does a green plastic shovel come in from the right edge with its blade tip resting on lumpy beach sand?\n3. Does the blue handled scoop push down into the sand until the blade is buried, then lift back up with a load of sand on the blade?\n4. As the scoop lifts, does sand spill over the lower edge of the blade and fall back down as loose grains?\n5. In the final frame, has the scoop moved up and to the right so only its green blade is left in the frame, at the top edge?\n6. In the final frame, is there a dug out hollow in the sand where the blade was, with ragged crumbly edges?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "internet_22_viscous_honey_dripping", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a wooden honey dipper above a glass mug? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the honey entering the tea stay a thin dark thread that coils and sinks toward the bottom of the glass, without mixing into the tea?\n3. In the first frame, does a hand hold a wooden honey dipper high above a glass mug of tea, its head coated in honey with a blob hanging off the bottom?\n4. In the first frame, does anything connect the dipper to the mug across the gap between the blob and the rim?\n5. As the hand lowers the dipper, does the hanging blob stretch into a long thin strand reaching into the tea without ever pinching off into separate drops?\n6. In the final frame, is the dipper just above the mug rim with one unbroken honey strand running from its tip down into the tea?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "internet_24_fresh_pasta_strands", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a metal pasta machine with hanging pasta ribbons? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Do the ribbons only bend while piling up, keeping the same width without stretching thin or tearing?\n3. In the first frame, do flat pale yellow pasta ribbons hang straight down from the cutter of a metal pasta machine, above empty parchment paper on the board?\n4. Do the ribbons come out of the cutter and get longer until their ends reach the paper?\n5. After an end touches down, does the strand buckle and fold back on itself so the pile grows upwards, with the last ends leaving the cutter and dropping onto the pile?\n6. In the final frame, is all of the pasta in one pile on the paper under the cutter, with nothing still hanging from the cutter?\n7. In the final frame, are the strands in the pile long and folded into loops, with none of them torn into short pieces?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "internet_25_transparent_rectangular_block", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 5 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like an empty white table? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the block bend and squash where it hits the table and then spring back straight, without staying deformed?\n3. In the first frame, is the white table empty, with no block in the frame yet?\n4. Does the transparent block drop into the frame from above and land on its bottom end, bending like jelly, then bounce back up off the table?\n5. In the final frame, is one transparent block with sharp corners lying on the table on its long side, in one piece with no bits broken off?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "internet_26_multi_needle_rigid", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a kinetic sand block with metal needles? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. After the needles pull out, do the holes stay open and the sand between the rows push up into small ridges, without flowing back in?\n3. In the first frame, is a rounded block of kinetic sand sitting on a light table, blue on the top, yellow in the middle and purple at the bottom?\n4. In the first frame, is a row of 10 thin metal needles stuck down into the blue top, with no holes in the rest of the blue surface?\n5. Does the row of needles lift straight up out of the sand and stab back down further back over and over, each poke leaving a new row of 10 holes stepping from the front edge towards the back?\n6. In the final frame, are the needles stuck back into the blue top behind the last row, with the block not slumped and the yellow and purple layers looking the same as at the start?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "internet_27_wooden_mallet_forcefully", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a light blue cylinder block standing upright? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the block deform permanently where the mallet presses, never springing back up?\n3. In the first frame, is a light blue cylinder block standing upright on a white table, with the mallet not in the frame yet?\n4. In the first frame, is there a small round dent in the middle of the flat top, with thin cracks running across the side?\n5. Does the wooden mallet come down and drive into the block so it squashes down and bulges out sideways, then fractures and spreads into a ring around the mallet head?\n6. In the final frame, is the block shape gone, with the material spread out flat in a wide wet-sand looking patch around the mallet head with a ragged edge?\n7. In the final frame, is the spread material broken up into fine crumbs rather than smooth?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "internet_28_plastic_blade_cuts", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a purple sand dome on a green disc? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. After the blade lifts out, does the sand keep its shape with the slices staying standing, not crumbling or slumping?\n3. In the first frame, is a purple sand dome sitting on a round green sand disc on a gray marble table, with a pink and a blue layer in between?\n4. In the first frame, does a purple plastic blade lie across the front of the dome with its tip on the green disc, the dome still in one piece?\n5. Is the blade pushed down through the dome and all the way through the green disc, then lifted back out and set down further back, 3 times?\n6. In the final frame, is the dome cut into 4 pieces, the big domed back piece and 3 slices in front of it, with the green disc cut in the same 3 places?\n7. In the final frame, are the cut faces flat with sharp edges, purple on top then pink then blue, and does the frontmost piece still have its rounded outer surface?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "internet_30_rigid_kitchen_utensils", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 4 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like an empty brown ceramic bowl? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. In the first frame, is an empty brown ceramic bowl sitting on a light gray table, with no pasta or tongs in the frame?\n3. In the first frame, is the inside of the bowl tan, with a thin reddish line around the rim?\n4. After the tongs carry a tight twirled nest of spaghetti down into the bowl and set it down, does the nest loosen and spread into a wider flatter pile?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "internet_31_liquid_egg_yolk", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a white bowl of loose white flour? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the egg spread only where it lands, with the yolk keeping its round shape and the flour around it staying dry and unmixed?\n3. In the first frame, is a white bowl filled with loose white flour with a lumpy uneven surface, and no egg in it?\n4. When the egg falls into the flour, does the yolk land whole while the white spreads outwards around it into a flat puddle?\n5. As the egg hits the flour, is a puff of white flour dust kicked sideways off the surface?\n6. In the final frame, is one whole round orange yolk sitting in one flat pool of pale egg white, with no second yolk and no burst pieces?\n7. In the final frame, is the pool a rough oval sunk into the flour, with a thin thread of white still running into it from the top of the frame?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "internet_32_spinning_top_precessing", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a metal spinning top balanced on its tip? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. At any point, does the lean of the top grow until it topples over?\n3. In the first frame, is a metal spinning top balanced on its tip on a flat gray surface, leaning to the right?\n4. In the first frame, does a dark oval shadow lie on the surface to the left of the tip, with nothing else in the scene?\n5. As the top keeps turning on its tip, does its axis wobble from leaning right to leaning left while the whole top walks leftwards and towards the camera?\n6. In the final frame, is there still only one top, in one piece and standing on its tip?\n7. In the final frame, has the top ended up about a third of its disc width to the left and lower in the frame, closer to the camera, with the shadow still touching the tip?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "internet_33_bridge_traffic_flowing", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like an orange steel bridge with a tall tower? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does any car leave the road surface or cross over the light median barrier?\n3. In the first frame, does an orange steel bridge deck run from bottom left up to top right over blue green water, with one big tower on the left blocking part of the deck?\n4. In the first frame, does a white scaffold platform hang under the deck right of the tower, with a small light blue box standing on it?\n5. In the final frame, are exactly two street lamps standing on the far railing to the right of the tower?\n6. In the final frame, have all the cars from the first frame left the visible deck, with the bridge and the hanging platform unmoved?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "internet_34_dart_striking_board", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a dart or a round board on a wall? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. After the tip sticks, does the dart swing down until the flight hangs almost vertical, then swing back up and settle, with the tip staying in the same spot?\n3. In the first frame, is a black and yellow dartboard on the wall with two darts already stuck in it, one red and one yellow?\n4. Does a second red dart fly in from the upper right and stick into the board just above the bullseye?\n5. In the final frame, are there three darts in the board, two red and one yellow, with none of them fallen out?\n6. In the final frame, is the second red dart stuck just above the first at the top edge of the bullseye, with the two red flights overlapping?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "internet_35_prayer_flags_flapping", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a string of coloured prayer flags? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. In the first frame, does a white string run from the upper left down to the right holding four whole flags, white blue yellow green, and a fifth red one cut by the right edge?\n3. In the first frame, does a second string of red flags hang lower and behind them, in front of a brown hillside and blue sky with clouds?\n4. Does the wind push the flags sideways so they swing and twist on the string, folding up into narrow triangles and opening back out to square shapes?\n5. In the final frame, does the top string still hold the same five flags in the same left to right order, white blue yellow green red?\n6. In the final frame, is the blue flag folded into a triangle with its left half hanging down as a dark point, while the white, yellow and green ones hang open and square?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "internet_36_ball_through_hoop", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a red basketball rim with a white net? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. After the ball is gone, does the net keep swinging and damp out, while the red rim itself does not move at any point?\n3. In the first frame, is a red basketball rim seen from below with a white net hanging down under it, and a see through backboard with a white painted rectangle behind it?\n4. Does a brown basketball come down from the top left, fall through the red rim and push down through the white net, dropping out at the bottom right?\n5. Does the net get pulled down and bulge out around the ball, then whip back up after the ball is out?\n6. In the final frame, is the ball out of the frame, with only the one red rim and its white net left?\n7. In the final frame, does the net hang still under the rim again, in the same shape as at the start?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "internet_37_putt_rolling_in", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a yellow golf ball and a black putter head? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the ball start rolling only once the putter face touches it, staying on top of the grass without sinking into the ground?\n3. In the first frame, is a yellow dimpled golf ball sitting on the short green grass with the black putter head right behind it?\n4. In the first frame, is the hole cut into the grass lower in the frame and closer to the camera, blurry and out of focus?\n5. Does the putter face push the ball so it rolls over the grass toward the camera, then over the far rim and into the hole?\n6. In the final frame, is the yellow ball gone from the grass, dropped into the hole and hidden behind the near rim?\n7. In the final frame, is the putter out of the frame, with the grass around the hole looking the same as at the start?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "manip_arena_02_robotic_arm_tilting", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 5 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a glass jug half full of water? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the blue mug stay in the same spot from start to end, with the water leaving only through the spout and not through the jug wall?\n3. In the first frame, does a clear glass jug with a white lid stand on the grey table half full of water, its surface flat and still?\n4. In the first frame, is an empty blue mug on the table left of the jug, with the black gripper at the right edge not touching the jug?\n5. In the final frame, is the jug tipped almost onto its side up off the table, with a thin water stream running from the spout into the blue mug?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "phys101_01_solid_object_dropped", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a glass tank of water? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. After the block reaches the tank bottom, does it stay in the same spot to the end, without bouncing back up or sinking through the glass?\n3. In the first frame, is a hand holding a small orange block over the glass tank, above the water surface?\n4. In the first frame, does water fill the lower part of the tank, with nothing lying on the tank bottom?\n5. Does the block drop out of the fingers, fall through the air and pull a pocket of air under the water, then sink much slower to the bottom while drifting left?\n6. In the final frame, is the orange block lying on the tank bottom a bit left of where it went in, with the hand above the water empty?\n7. In the final frame, does the block still have the same rounded shape it had in the fingers, not squashed or broken open?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "phys101_03_soft_dough_slides", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 8 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a teal dough lump on a white ramp? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Do the blue and green objects pass through the white object at any point?\n3. Does the white block move only once the dough hits it and the green box only once the block reaches it, without any of the three passing into each other?\n4. In the first frame, do fingers hold a teal dough lump at the top of a white ramp sloping down to the right, its surface dented and creased?\n5. In the first frame, does a white block with a rough foam surface sit at the foot of the ramp on the beige table, with a flat green box further right and a gap between them?\n6. Does the dough slide down the ramp into the white block, which slides right into the green box and shoves it along, all three then slowing and stopping?\n7. In the final frame, have the dough, the white block and the green box all moved right and ended up touching in a row with no gap?\n8. In the final frame, is the dough still one lump, not flattened out or broken apart?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "phys101_04_suspended_spring_mass", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a patterned cube hanging from a grey spring? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the cube only move up and down with the spring, never reaching the mat below and staying in front of the black post without cutting into it?\n3. In the first frame, does a red and blue patterned cube hang from a grey coiled spring above a grey cutting mat, not touching the mat?\n4. In the first frame, is the top end of the spring cut off by the top edge of the frame?\n5. Does the cube bounce up and down on the spring about 7 times over the clip, with the bounces getting smaller towards the end?\n6. Do the coils pull apart and the spring bow sideways as the cube drops, then close back up and straighten as it rises?\n7. In the final frame, is the cube back at about the same height as in the first frame, still hanging on the spring above the mat?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "phys_ad_01_rigid_mechanical_gripper", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 8 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like an orange basketball on a dark shiny floor? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. After the fingers lift, does the ball spring back to round and stay where it is, without the fingertips sinking through its surface?\n3. In the first frame, does an orange basketball with black seam lines sit on a dark shiny floor, round and not squashed?\n4. In the first frame, does a gripper hang above the ball with two white fingers apart and not touching it, the rest of the room black?\n5. Does the gripper come straight down so both fingers press on top of the ball, squashing it down and flattening the top, then lift back up?\n6. At any point, do the two fingers close in on the ball instead of staying the same distance apart?\n7. In the final frame, is the gripper back up at the top of the frame with the fingers off the ball again?\n8. In the final frame, is the ball round again and in the same place, with no dent or flat spot left on top?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "phys_ad_03_mechanical_arm_rotating", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a clear plastic bottle hanging upside down? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does any water move while the arm is not turning the bottle, or pass through the bottle wall or the cap?\n3. In the first frame, does a clear plastic bottle hang upside down from a white clamp on a dark mechanical arm entering from the right, cap at the bottom?\n4. In the first frame, does water fill the lower bottle with a flat level surface, while the ribbed end on top holds air and small droplets on the inside wall?\n5. Does the arm turn the bottle over until the cap points up, then turn it back down to where it started?\n6. As the bottle turns, does the water run to whichever end is lowest and break into waves, going flat again once the bottle stops?\n7. In the final frame, is the bottle cap down in the same spot with the water flat and level at the same height as in the first frame?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "phys_ad_04_meshing_gears_rotating", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 5 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a set of grey gears meshed together? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. At any point, do the gear teeth pass through each other or does the hard plastic squash where they press?\n3. In the first frame, are three grey gears meshed on beige beams, two side by side on top and one below between them, each on a tan cross axle?\n4. In the first frame, do the two top gears touch each other, instead of having a gap between them showing the beam and a round hole?\n5. In the final frame, are the three gears still in the same spots on the beams and still meshed, with nothing come apart?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "physics_iq_benchmark_01_ball_wooden_block", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a hanging brown tennis ball and a red block? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Do the cushions dent under the ball and the block without either passing through the cloth, with the ball stopping in the dent instead of bouncing off?\n3. In the first frame, do a brown tennis ball in a blue clamp on the left and an upright red block in an orange clamp on the right hang from the same black bar at the same height?\n4. In the first frame, are two white padded cushions side by side below them with a dark gap down the middle and nothing lying on either?\n5. Do both clamps open so the two objects drop straight onto the cushions, the ball staying where it hits and the block landing on its end and toppling left onto its flat side?\n6. In the final frame, does the ball sit in a dent it pressed into the left cushion while the block lies flat on its largest face on the right cushion?\n7. In the final frame, does the block still have sharp square edges and the ball stay round, with neither squashed or dented?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "physics_iq_benchmark_02_domino_effect_row", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a row of upright coloured blocks? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Do any of the blocks pass through each other, or start moving before the block behind it hits it?\n3. In the first frame, do six blocks stand upright in a row on the wooden table, yellow, red, pink, green, blue and purple from left to right, with a gap between each one?\n4. In the first frame, is a toothpick taped to the lid of the black round box on the right, pointing off to the right and not touching the purple block?\n5. Does the toothpick swing around with the lid and push the purple block left, so each block tips onto the next down the row until the whole row is down?\n6. In the final frame, is the yellow block still in the frame, rather than gone out past the left edge?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "physics_iq_benchmark_03_rolling_ball_collides", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like two fuzzy tennis balls touching each other? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Do any of the balls pass through each other, or start moving before another ball touches them?\n3. In the first frame, do a dark brown and an orange tennis ball sit touching near the far edge of the wooden table, orange on the right?\n4. In the first frame, are both balls fuzzy felt with a white seam curve, with no third ball present?\n5. Does a grey tennis ball roll in from the left and hit the brown ball, which moves right into the orange ball, sending it off the table edge out of frame?\n6. In the final frame, is the orange ball still in the frame?\n7. In the final frame, is a grey tennis ball resting against the brown ball and further from the camera, with the brown ball right of where it started?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "physics_iq_benchmark_05_continuous_stream_viscous", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 8 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a yellow rubber duck in a dark metal tray? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Is the duck pushed or tipped over by the stream, or does the liquid pass through it?\n3. In the first frame, is a yellow rubber duck standing in the middle of an empty dark metal tray with no liquid in it?\n4. In the first frame, does a blue tap stick out of a red container above the duck, with nothing running out of it?\n5. After the tap opens, does the red stream land on top of the duck's head, split and run down its sides, then pool around its base and spread over the tray?\n6. Does the stream stay one unbroken strand from the tap down to the head, without breaking into drops or splashing where it lands?\n7. In the final frame, does a red pool cover the tray floor and reach the left and right walls, leaving one bare patch near the front middle?\n8. Is the pool edge a thick rounded rim standing up off the tray rather than a thin film, with the duck still in the same spot and red running down its sides?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "physics_iq_benchmark_06_pouring_liquid_cup", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a glass cup of orange juice? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does juice pass through the glass or the tray instead of staying inside the cup until it reaches the rim?\n3. In the first frame, is the glass cup on the dark metal tray three quarters full of orange juice, with a thin stream pouring in from the blue tap above?\n4. Does the cup fill to the rim, then juice spill over and run down the outside of the cup as a sheet before spreading across the tray?\n5. In the final frame, is the left end of the tray mostly dry?\n6. In the final frame, is the cup full to the brim with juice running down its outside and a pool covering the right half and front of the tray?\n7. In the final frame, is the left end of the tray dry, the juice still inside the tray rim, and the pool's front edge a smooth curved line?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "physics_iq_benchmark_07_ball_rolls_down", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a white board with taped-on coloured ramps? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the ball ever pass through a ramp, or does any ramp move when the ball lands on it?\n3. In the first frame, are coloured ramps taped onto a white board one above the other, each tilted the opposite way to the one above it?\n4. In the first frame, is there no ball yet, with the lowest piece a magenta striped U shape whose opening faces up?\n5. In the final frame, is a yellow ball sitting in the magenta U shape at the bottom, resting against the inside of its left wall?\n6. In the final frame, are all the ramps empty and still in the same places at the same angles as in the first frame?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "physics_iq_benchmark_08_silk_cloth_thrown", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a blue teapot with pink flowers? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the cloth stop on the teapot and take its shape without sinking through the pot or the table?\n3. In the first frame, does a blue teapot with pink flowers, a red handle and spout and a green lid stand uncovered on the wooden table?\n4. In the first frame, does a cream silk cloth hang behind the teapot and reach down to the table?\n5. Is the cream cloth thrown from behind over the teapot and does it fall forwards onto it, covering the lid first and then the body down to the checkered base?\n6. In the final frame, is the cloth draped over the whole teapot with no part of the blue pot visible, peaking up in the middle where the lid is?\n7. In the final frame, does the silk crease into many thin folds running down from the peak, with a ridge standing out to the right where the spout is?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "physics_iq_benchmark_10_rolling_ball_collides", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a yellow rubber duck standing upright? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the duck move before the ball touches it, or does the ball pass through the duck?\n3. In the first frame, does a yellow rubber duck stand upright right of the middle on the light wooden table, facing left, with the table top around it empty?\n4. In the first frame, is the brown ball in the frame?\n5. Does the brown ball roll in from the left and hit the duck from the left, so the duck slides right and the ball deflects right away from the camera, with neither deforming?\n6. In the final frame, has the brown ball come to a stop on the table at the far edge behind the duck without rolling off?\n7. In the final frame, is the duck still upright, sitting further to the right than at the start and turned a bit towards the camera?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "physics_iq_benchmark_11_small_ball_rolling", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a brown board leaning on a blue block? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the ball roll along on top of the board without sinking into it, while the board and the blue block stay still?\n3. In the first frame, does a brown board lean on a blue block on the right side of the table, with its low end lying flat on the light wood?\n4. In the first frame, is the table left of the board empty, with no ball in the frame?\n5. Does a small yellow green ball roll in from the left edge, cross the table and run up the brown board?\n6. Does the ball slow to a stop partway up the board without reaching the blue block, then roll back down and carry on left out of the frame?\n7. In the final frame, is the table empty with the ball gone from the frame, and the brown board and blue block in the same place as at the start?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "physics_iq_benchmark_12_overhead_clamp_releases", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a white stick hanging above a blue mug? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the liquid start moving only when the stick falls into it, with the mug staying in the same spot from start to end?\n3. In the first frame, does a flat white stick hang from a blue clamp at the top of the frame, its lower end above the dark red liquid in the blue mug and not touching it?\n4. In the first frame, is the liquid surface flat and still, and the liquid dark enough that the inside bottom of the mug is not visible?\n5. After the clamp opens, does the stick drop straight down into the liquid so the liquid splashes up in thin sheets and throws small separate drops over the rim onto the table?\n6. In the final frame, is the white stick out of sight under the liquid, with the clamp jaws apart and pulled back to the top edge of the frame?\n7. In the final frame, is the liquid surface flat again, with a few small orange drops sitting on the table left of the mug?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "physics_iq_benchmark_13_magnet_attracting_pulling", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a wrench lying on a black disc? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the wrench stop dead on the magnet face and stay stuck there to the end, without bouncing off, sinking into the magnet, or pushing the magnet back?\n3. In the first frame, is a round silver magnet standing on its rim on a purple tape strip on the left, tilted back so its flat round face points up to the right?\n4. In the first frame, is a metal wrench lying flat on top of the black disc on the right near the front right edge, with nothing else on the disc?\n5. Does the wrench ride around on the turning black disc on a curve towards the magnet, then near the disc's left edge get pulled off sideways and slap onto the magnet face in one quick snap?\n6. In the final frame, is the wrench stuck flat against the tilted face of the magnet at its right edge, with the open jaw end up?\n7. In the final frame, is the black disc top empty, with the magnet standing in the same spot on the tape as at the start?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "physics_iq_benchmark_14_unstable_stack_wooden", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a yellow beam balanced on a red block? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the red block stay standing the whole time and barely shift, with the falling blocks bouncing off the table and not sinking into it?\n3. In the first frame, is a yellow beam balanced across the top of an upright red block, hanging over further on the right side than on the left?\n4. In the first frame, is a blue block held by orange tongs with its bottom end resting on the right end of the yellow beam?\n5. After the orange tongs open and lift away to let the blue block go, does it push down the right end of the yellow beam so the beam tips right, slides off the red block, and both land on the table?\n6. In the final frame, do the blocks still have sharp square corners, with none of them dented or broken?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "robo360_02_robotic_arm_gathering", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a yellow rope in a tangled pile? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. In the first frame, does a yellow rope lie in one loose tangled pile on the red and white checked table, flat with open loops and none of it lifted?\n3. In the first frame, is the grey basket at the top left empty, with the white arm and its open black gripper hanging above the rope?\n4. Does the gripper close on the rope and lift it out of the top of the frame, dragging the hanging rope left and dropping it into the grey basket, then come back down and do it a second time?\n5. In the final frame, is part of the rope in the grey basket hanging over its near rim, with the rest on the table under the basket and one long loop reaching out to the right?\n6. In the final frame, is the rope still one piece, bending into loops and kinks without stretching or getting thinner anywhere?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "robo360_03_robotic_arm_tilting", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 9 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a translucent plastic cup standing upright? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Do any grains pass through the cup's wall or base instead of leaving through the top opening?\n3. Do the grains fall only while the cup is tipped over and stay on top of the plate, with none passing through it or landing on the napkin?\n4. In the first frame, does a translucent plastic cup stand upright on the tablecloth at the left edge, with the white robot arm above the table and nothing in its gripper?\n5. In the first frame, is the grey plate in front of the cup empty, with what is inside the cup not made out through the frosted plastic?\n6. Does the cup tip over so its opening points down toward the plate?\n7. As the cup tips, does its opening turn toward the left?\n8. Does the gripper close on the cup, lift it off the table and bring it over the plate, then tilt it until the dark grains pour out in a stream onto the plate?\n9. In the final frame, is the mound loose single grains with a ragged edge, with more single grains scattered around it and all of it inside the plate?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "robo360_05_robotic_arm_driving", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 5 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like green cucumber pieces on a grey plate? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. In the first frame, are five cucumber pieces lying apart on a grey plate, with the fork in the gripper over the plate but not stuck into any of them?\n3. In the first frame, are the cucumber pieces dark green and ridged, with pale green wet looking cut ends?\n4. In the final frame, are three cucumber pieces stacked on the fork and held up off the plate?\n5. In the final frame, are exactly two pieces still lying flat on the plate, with the rest of the plate empty except for wet smears?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "robo_cook_01_robotic_spatula_scrapes", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a tan dough sheet with a round disc? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the dough move only where the spatula touches it, with the round disc staying in the same spot on the table from start to end?\n3. In the first frame, is a pale tan dough sheet lying flat on the grey table, with a round disc pressed into the middle and ragged excess dough sticking out all around the disc?\n4. In the first frame, does the robot hold the light blue spatula above the table at the top of the frame, not touching the dough?\n5. Does the spatula come down right of the dough and sweep around the rim of the disc so the excess peels off into a long thin strip trailing behind the blade, then carry that strip to the bottom of the frame?\n6. In the final frame, is the ragged excess gone, leaving a clean round dough disc in the same spot with one small tab on its right edge and a crumb lying left of it?\n7. In the final frame, does the scraped off dough sit bunched into a folded wad at the bottom of the frame next to the grey fixture?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "robo_cook_04_rigid_robotic_roller", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a light blue roller and a dough lump? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. After the roller lifts off, does the dough stay flat instead of springing back, with the dumplings on the board never moving?\n3. In the first frame, does a light blue roller hang from the robot gripper at the left of the frame, away from the dough?\n4. In the first frame, does one thick rounded lump of pale dough sit on its own on the grey table, with the wooden board behind it full of pale dumplings?\n5. Does the roller come straight down onto the dough lump and press on it, so the lump squashes flat and the dough spreads out sideways to the right from under the roller?\n6. In the final frame, is the lump gone, replaced by a wide flat sheet of dough with a ragged edge?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "robo_craft_02_robotic_gripper_presses", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a blue clay block on a green block? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the clay move only where the gripper fingers push into it, keeping every dent instead of springing back, with the green block under it neither deforming nor shifting?\n3. In the first frame, is a blue clay block with rounded corners sitting on top of a green block on the white table, its sides smooth with no dents in them?\n4. In the first frame, is the gripper in the frame?\n5. Do the two gripper fingers come down and pinch into the blue block again and again from different sides, each press squashing the clay in so the material bulges out between the fingers?\n6. In the final frame, is the blue block pressed down flatter and wider into a lobed shape with rounded arms sticking out sideways, still one connected lump?\n7. In the final frame, are the grooves between the lobes smooth and rounded, with the clay not torn or crumbled anywhere?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "robo_craft_03_rigid_robotic_arm", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a flat blue sheet and a silver press? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the sheet move only while the tool pushes it, draping over the press without passing through the metal, with the press itself not moving?\n3. In the first frame, does a flat blue sheet lie on the white table to the right of a silver dumpling press, the two not touching?\n4. In the first frame, is the press open and empty, with the metal bowl and the fluted rim bare?\n5. Does the arm bring its tool down behind the blue sheet and push it to the left across the table onto the press, the sheet bending and folding over the rim as it rides up and staying in one piece?\n6. In the final frame, is the blue sheet draped over the press covering the metal bowl, with only the fluted rim along the near edge and the wire handles still showing?\n7. In the final frame, is the sheet no longer flat, curving over the press with its edge hanging down past the rim?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "t_rex_01_bimanual_robotic_hands", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a crumpled silver foil sheet? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the foil move only where a hand holds it, staying in the stretched shape instead of springing back to crumpled?\n3. In the first frame, does a crumpled silver foil sheet lie flat on the wooden table, with the hand on the right already down on its right edge?\n4. In the first frame, is the hand on the left open and up in the air, not touching anything?\n5. Does the hand on the right close on the foil and lift it off the table, then the hand on the left grip the other side so the two pull apart until the foil opens into a wide sheet?\n6. In the final frame, is the foil pulled open into a wide sheet held up between the two hands, across the middle of the table?\n7. In the final frame, is the sheet covered in creases and wrinkles all over from being crumpled, rather than smooth?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "t_rex_02_dexterous_bimanual_robotic", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a robot hand or a cloth on a table? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the cloth move anywhere the hands are not holding it, or pass through the table or through itself?\n3. In the first frame, does a beige cloth with dark brown checks lie bunched up on the wooden table, heaped up in the middle with deep folds?\n4. In the first frame, are the two white robot hands down at the left and right edge of the cloth, with no part of the cloth lifted off the table?\n5. Do the two hands pinch the near corners and lift the cloth clear of the table, where it sags into a deep U between them, then pull it apart sideways and lower it flat?\n6. In the final frame, is a bunched strip with loose threads still left along the far edge, so the cloth is not smooth?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "t_rex_03_dexterous_robot_hands", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a pale pink paper sheet lying flat? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the paper move anywhere no hand is pushing it, or pass through the table or through the other half of the sheet?\n3. In the first frame, does a pale pink paper sheet lie open flat on the wooden table, creased down the middle into two halves?\n4. In the first frame, are both white robot hands up above the table, with neither one touching the paper?\n5. Does the left robot hand push the left half of the sheet up and over the middle crease onto the right half while the right hand stays down at the right edge, the paper bending in a smooth curve without crumpling?\n6. In the final frame, is the sheet folded in half into one narrower rectangle sitting over where the right half was, with the fold edge on the left?\n7. In the final frame, do the two layers at the near edge not lie exactly on top of each other, and are both hands off the paper?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "t_rex_04_dexterous_robotic_hands", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a white book lying open? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the book move anywhere no hand is touching it, or do the fingers pass through the pages?\n3. In the first frame, is a white book lying open and flat on the wooden table with both pages blank?\n4. In the first frame, are the two robotic hands out to the left and the right of the book, with neither of them touching it?\n5. Does the left hand press flat on the left half while the right hand's fingers slide under the right half and tip it up and over to the left, staying flat and straight as it swings around the spine onto the left half?\n6. In the final frame, is the book closed and lying flat on the table, with the blue printed cover facing up?\n7. In the final frame, are the edges of the closed book straight, with no page bent or sticking out?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "task_level_ilc_01_robot_swinging_rope", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a robot arm? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. As the rope swings across the green arm links, does it pass through the arm or through itself where it crosses, rather than staying in front of the links?\n3. In the first frame, does a green robot arm stand on a dark pedestal, bent so the gripper sits at the top, with a white rope held in the gripper?\n4. In the first frame, does the rope hang straight down in front of the pedestal in one smooth line with no bends or loops, with a green tip at its free lower end?\n5. Does the arm straighten up and then whip the gripper over to the left and down, throwing the rope's free end up above the gripper into a big loop that travels down the rope as the end swings back below?\n6. In the final frame, is the arm leaned over to the left with the gripper down on the left side, and the rope hanging from it clear of the pedestal?\n7. In the final frame, is the rope no longer straight, with its lower part curled into a small loop that crosses over itself and the green tip hanging free above the cloth?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "wisa_80k_01_domino_chain_reaction", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 5 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a row of white dominoes standing upright? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the ball come back down onto the bare floor in front of the fallen dominoes and bounce off to the left out of the frame, without shifting the fallen blocks or passing through them?\n3. In the first frame, is a row of white dominoes standing upright on the wooden floor, getting bigger from left to right, with none tipped over?\n4. In the first frame, is a blue ball at the right end of a wooden plank lying over a small white block, with bare floor between the plank and the biggest domino?\n5. Do the dominoes topple one after the other to the right, the last one dropping onto the left end of the plank and flipping the blue ball up out of the top of the frame?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "wisa_80k_02_brachistochrone_curve_experiment", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a metal rail curving down from a post? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does each ball stay on its own rail all the way down and keep its round shape, without passing through the rails or touching another ball after the start?\n3. In the first frame, do three metal rails run from the top of a post on the left down to a clamp on the right, the top one bulging upwards, the middle one nearly straight and the bottom one dipping steeply then flattening out?\n4. Do the balls get released at the top and roll down one per rail, the orange one on the dipping rail dropping fastest and catching up with the blue one, while the red one on the bulging rail barely drops and stays behind?\n5. In the final frame, are the three balls spread out, each on its own rail, with the orange one lowest and furthest right, the blue one above it and the red one near the top left?\n6. In the final frame, has any of the balls reached the bottom end of the rails?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "wisa_80k_04_marble_rolling_along", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a wooden board with a carved wavy groove? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the marble stay inside the groove the whole way, pushed up and down by the wooden waves instead of passing through them?\n3. In the first frame, does a hand hold a blue cup against the right end of the wooden board, with the marble not yet visible?\n4. In the first frame, is the track a wavy groove cut into the board that runs to the left and ends in a round wooden bowl?\n5. Does the blue marble come out of the cup and roll left along the wavy groove, up over each crest and down into each trough, speeding up the further left it gets, and out into the round bowl?\n6. In the final frame, is the blue marble in the round bowl at the left end and still rolling back and forth in it, not yet settled?\n7. In the final frame, is the wavy groove empty, with the hand and the blue cup gone from the right edge?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "wisa_80k_05_cue_stick_hitting", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a cluster of upright white and yellow slats? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does any coloured ball start moving before the tipping slats reach it, or pass through the slats or through another ball?\n3. In the first frame, do six coloured balls sit in a ring around a tight cluster of white and yellow slats standing upright on the green table?\n4. In the first frame, does a row of thin red slats stand upright between the cluster and the white ball on the left, with the cue stick tip behind the white ball cut off by the left edge?\n5. Does the white ball roll right and stop against the left end of the red slats, after which the slats tip over outward from the centre and shove the six coloured balls away in six directions?\n6. In the final frame, are all six coloured balls gone off the table, with only the white ball left sitting against the left end of the red slats?\n7. In the final frame, have all the slats tipped over flat, the red ones into one long ribbed band and the white and yellow ones into six arrows pointing out from the centre?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "wisa_80k_06_pouring_red_wine", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a tilted wine glass with dark red wine? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. At any point, does any wine splash over the rim or pass through the glass wall instead of staying inside the glass?\n3. In the first frame, is a wine glass tilted to the right with dark red wine in the bottom of the bowl, its stem and base cut off by the bottom edge?\n4. In the first frame, does a red wine stream pour in from the top edge over the left side of the rim as one connected wobbly ribbon, with no bottle visible?\n5. Does the stream fall into the left half of the glass and plunge under the surface, with the wine collecting on the low right side of the tilted bowl as the level climbs?\n6. In the final frame, is the pour still going with the wine level risen, the dark wine sitting higher up the right wall of the bowl?\n7. In the final frame, is the wine surface churned up with a pale pink froth patch on it where the stream goes in?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "wisa_80k_07_rocking_tank_wave", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a clear tank of blue water? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. At any point, does the water move without the tank tilting, or pass through the clear walls?\n3. In the first frame, is a long clear tank with blue water in it tilted down to the right on a white mount on a grey board?\n4. In the first frame, does the water lie along the whole bottom and sit deeper at the low right end, with a choppy surface carrying small crests?\n5. Does the tank rock on the mount down to the left and then back down to the right while the water sloshes end to end and runs up the raised end as a wave?\n6. In the final frame, is the tank tilted down to the right again but with the water heaped up at the raised left end?\n7. In the final frame, does the water surface slope down from the left heap to a thin layer at the low right end instead of lying level?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "wisa_80k_08_large_domino_pyramid", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a pyramid of upright coloured dominoes? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. At any point, does a domino tip before the one before it hits it, or do fallen dominos pass through each other?\n3. In the first frame, is a nine-level pyramid built from upright pink, teal and grey dominos with flat yellow and grey dominos laid across them as bridges?\n4. In the first frame, do the dominos in front of the pyramid stand in rows that run off both the left and right edges, all upright and none tipped?\n5. Does the tipping start at the bottom left corner of the frame and run along the rows in front of the pyramid, after which the pyramid topples from left to right?\n6. In the final frame, is the pyramid gone and lying flat in a heap on the ground, with every domino still a whole rigid block, none bent or broken?\n7. In the final frame, is any domino left standing anywhere in the frame, including in the rows that run out to both edges?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "wisa_80k_09_playground_swing_suspended", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a yellow swing seat hanging on chains? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. At any point, does the seat touch the blue post as it crosses in front of it, or touch the ground?\n3. In the first frame, does a yellow plastic baby swing seat hang on four chains just left of the blue post, well above the red ground?\n4. In the first frame, do the chains run up out of the top of the frame, with the bar they hang from not visible?\n5. Does the yellow seat swing left and right across the frame for about four full passes, hanging lowest crossing the middle, riding up at both ends and reaching less far each pass?\n6. In the final frame, has the yellow seat swung over to the right side of the frame, hanging in front of the blue post?\n7. In the final frame, is the seat the same shape as at the start, with the hard plastic not bent or dented and the chains still straight?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "wisa_80k_11_two_strands_magnetic", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like two strands of silver metal balls? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. As the two rows pull together, do any balls stop touching along their strand, or overlap or pass through each other?\n3. In the first frame, do two strands of silver metal balls run in from the left edge to a hand on the right, forming a wide open v with white table between them?\n4. In the first frame, is each strand a single row of same sized balls touching end to end, with the left ends of both strands cut off by the frame edge?\n5. Do the two strands snap together starting at the hand, with the closing point travelling left along them until it runs off the left edge of the frame?\n6. In the final frame, have the two strands closed together into one straight flat band running from the hand off the left edge, with the v gone?\n7. In the final frame, do the balls of the two rows sit offset, each ball in the dip between two balls of the other row with no gap left between the strands?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "wisa_80k_12_marble_rolling_along", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a dark wood board with light wooden rails? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. At any point on the way down, does the marble sink into a rail or pass through one instead of riding on top of it?\n3. In the first frame, are light wooden rails taped onto a dark wood board at different angles with gaps between them, the long rail with the blue tape lying almost flat across the middle?\n4. In the first frame, is the silver marble in the frame?\n5. Does the silver marble roll right along the top rail and drop off its end onto the long taped rail, which tips over under it and swings up past upright, the marble then zig zagging down the lower rails and off the right edge?\n6. In the final frame, is the long taped rail standing up steeply, with its lower end down on the bottom rail?\n7. In the final frame, is the marble still seen?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "wisa_80k_14_conveyor_belt_moving", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 5 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a black conveyor belt with two yellow rails? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Do the cubes move only because the belt carries them, with the yellow rails staying in the same place and no cube penetrating a rail or another cube?\n3. In the first frame, do the two yellow rails sit over the belt at an angle, with neither end of the belt in the frame?\n4. In the final frame, is the blue cube past the left yellow rail and further out on the belt, with the green cube that started at that rail gone out of the frame on the left?\n5. In the final frame, have the red and the green cube come down to the left rail, with all the cubes still having sharp corners and none of them tipped over?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "wisa_80k_18_s_shaped_domino", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 5 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a curving line of coloured dominoes? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does each domino move only when the one behind it hits it, with the fallen ones stacking on each other without passing through each other or into the ground?\n3. In the first frame, do pink, teal and yellow dominoes stand on the concrete in a line curving into a big S, with straight lines running off the left edge and the top right?\n4. In the final frame, is the whole S knocked down except for two pink dominoes still standing at the corner where the top of the S meets the line going off to the right?\n5. In the final frame, are the fallen dominoes still sharp edged blocks, none bent or broken, with those in the straight line at the left lying stacked leaning on each other?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "wisa_80k_19_domino_line_triggers", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a line of white dominoes on stairs? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Do the cards pass through the yellow blocks on the steps, or do any of those blocks move as the cards flip over them?\n3. In the first frame, is a blue card standing upright on the top step of the teal stairs and a red card on the top step of the pink stairs?\n4. In the first frame, is the line of white dominoes running up to the top of the stairs all standing upright, with none of them tipped?\n5. Does the white domino line topple along until it reaches the top of the stairs and knocks both cards over?\n6. Does each card tumble end over end down its own staircase, staying stiff with sharp corners instead of bending?\n7. In the final frame, is the white domino line at the top left all down, leaning on each other in a sawtooth?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "wisa_80k_21_car_tire_running", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 4 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a row of round squishy toys? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. In the first frame, do three round squishy toys, a pink one, an orange one and a yellow one, sit side by side on the asphalt, all three plump and undeformed?\n3. In the first frame, is the black tire at the right edge of the frame next to the yellow toy, with only a small clump of pink beads on the ground under the orange one?\n4. Does the tire roll to the left over the row and squash the yellow toy first, then the orange and then the pink, each flattening into a wide low blob under the tread?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "wisa_80k_23_dominoes_toppling_along", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a looping line of coloured dominoes? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does each domino fall only when the one before it hits it, without passing through each other or through the black rail, while the rail on its blue stand stays in the same place from start to end?\n3. In the first frame, do the coloured dominoes all stand upright in a long line that winds in loops over the wooden floor and runs off the right edge, its end not visible?\n4. In the first frame, does a white domino stand at the top end of the black rail, with the slots down the rest of the rail filled with upright coloured dominoes?\n5. Does a wooden stick come in from the left and tip the white domino at the top of the rail, with the toppling running down the rail and then on along the line on the floor?\n6. In the final frame, is every domino knocked down with not one left standing, lying flat and overlapping each other along the same curved path the line had?\n7. In the final frame, are the slots of the black rail all empty, with the dominoes that stood in it slid down to its low end and the white one among them?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "wisa_80k_27_mousetrap_snapping_shut", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a mousetrap? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. As the tilted trap snaps, does a long thin wire swing up off it and end up pointing up and to the right, above the traps?\n3. Does the snap of the tilted trap also set off the flat mousetrap resting under it, so that both traps end up closed?\n4. In the first frame, are there two wooden Victor mousetraps on a dark textured floor in front of a brick wall, one lying flat with a pink bait pedal and a second propped at an angle behind it with a yellow bait pedal?\n5. In the first frame, are both mousetraps still set, with each snap bar held back towards the right and neither one closed?\n6. Does the tilted mousetrap with the yellow pedal snap shut, its bar swinging over the pedal, while the flat mousetrap with the pink pedal stays set?\n7. In the final frame, is the yellow-pedal trap closed and lying flatter and further left than where it started, with the pink-pedal trap still set and its bar held back?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "wisa_80k_29_milk_pouring_bowl", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a white bowl of yellow cornflakes? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Do the flakes move only where the milk reaches them, without sinking through the bowl or through each other?\n3. In the first frame, is a white bowl full of yellow curled cornflakes with a white milk stream falling into its middle?\n4. In the first frame, does the milk stream come in from the top edge of the frame, with whatever pours it not visible?\n5. Does the milk come down as one unbroken rope that breaks into splashes and droplets only where it lands on the flakes, while the stream drifts left across the bowl?\n6. In the final frame, are the flakes where the stream lands pushed down with milk pooled between them, the flakes still whole and yellow?\n7. In the final frame, are white milk droplets scattered in the black background above and to the right of the bowl?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "wisa_80k_31_continuous_water_stream", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a blue bucket full of water? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does any water pass through the bucket wall instead of leaving over the rim and running down the outside?\n3. In the first frame, is a blue bucket filled to the rim with a water stream falling in from the top edge, the bucket bottom and ground not visible?\n4. In the first frame, is water running over the left side of the rim and down the outside wall?\n5. Does the stream pour the whole clip as a clear column that breaks into white froth where it hits the surface, with the extra water leaving over the left rim?\n6. In the final frame, is the bucket still full to the rim with water spilling over the left side, the level not risen above the rim?\n7. In the final frame, is the surface churned into white foam and bubbles around where the stream lands, rather than flat?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "wisa_80k_32_hydraulic_press_squashing", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a rainbow ball on a round steel plate? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the ball flatten only while the top plate pushes down, with the rubber squeezed sideways past the plate edge and not passing through either plate?\n3. In the first frame, is a rainbow ball, pink to orange to yellow to green, sitting round and unsquashed on a round steel plate?\n4. In the first frame, is the round steel top plate right above the ball and wider than the ball?\n5. In the final frame, is the ball shape gone, the rubber pressed into a thin flat band pinched between the two plates and sticking out past their rim?\n6. In the final frame, is the squeezed rubber wrinkled into folds at the pink end and still one piece, with nothing broken off onto the table?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "wisa_80k_33_domino_line_triggering", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 4 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like upright dominoes standing in rows? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. In the first frame, do black dominos stand upright in a grid with wooden sticks laid across them in two levels, nothing leaning or fallen?\n3. In the first frame, does a long line of coloured dominos stand upright in front of the grid, running in from the left edge so the first one is not visible?\n4. Does the coloured line topple along its length into the black legs at the front left, after which the grid comes down and the collapse spreads right and back?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "wisa_80k_34_marbles_rolling_down", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 5 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a white spiral ramp with coloured marbles? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. As the marbles knock into each other, do any of them lose their hard round shape or pass through each other or the walls of the spiral?\n3. In the first frame, is the white spiral ramp full of red, yellow, green and blue marbles lying in its grooves, with a dark round hole in the middle?\n4. Do the marbles roll down the zigzag track onto the outer ring of the spiral, round the grooves inwards, and drop out one by one through the middle hole?\n5. In the final frame, are exactly 10 marbles left in the spiral grooves, with one blue marble sitting down in the hole in the middle?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "wisa_80k_35_thick_melted_chocolate", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a light brown triangle chocolate mould? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the chocolate run over the divider into the neighbouring compartments or pass through the mould?\n3. In the first frame, is a light brown chocolate mould with triangle pyramid compartments sitting on the dark speckled counter?\n4. In the first frame, is thick chocolate already pouring into the right compartment from a clear jug cut off by the right edge, with the triangle tips still sticking out above the chocolate?\n5. Does the thick chocolate pour into the right compartment the whole clip, the falling rope coiling and folding over itself where it lands while the pool builds up and spreads over the triangle pattern, without splashing or breaking into drops?\n6. In the final frame, is the stream still pouring, with the chocolate stacked up in fine folds around where it lands?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "wisa_80k_36_hydraulic_press_compressing", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a coil spring on a striped block? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the spring shorten only while the press head pushes down on it, the coils pressing onto each other without passing through each other or the lower block?\n3. In the first frame, does a dark grey coil spring stand upright on the flat top of the lower yellow and black striped block, with open gaps between all its coils?\n4. In the first frame, is the striped press head above the spring already touching the top coil, with no gap under its bottom face?\n5. Does the press head move straight down and shorten the spring, the gaps closing from the top coil downwards until all coils touch, then stop and stay there?\n6. In the final frame, has the press head come down and squashed the spring to under half its starting height, with the coils stacked flat and no gaps left?\n7. In the final frame, are the coils still round and the spring standing on the same spot of the lower block, not bent over to one side?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "wisa_80k_41_tennis_balls_bouncing", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a black racket with a yellow grip? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Do the balls sink through the strings or the court, or does the racket move when a ball lands on it?\n3. In the first frame, does a black racket with a yellow grip lie on the blue green court with empty strings?\n4. In the first frame, are two tennis balls cut off by the right edge of the frame, with the rest of the court empty?\n5. Do balls keep coming in from the right edge and bounce leftwards across the court and off the racket strings, with lower hops each time until they only roll?\n6. In the final frame, are 4 balls in the frame, one resting on the strings at the left edge of the racket head, one on the court in front of the racket and two cut off by the top edge?\n7. In the final frame, is any of the balls flattened or dented where it landed?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "wisa_80k_42_hydraulic_press_crushing", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a yellow duck on a stack of rings? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Do the rings squash and bulge out sideways where the press pushes, without passing through each other or through the press head?\n3. In the first frame, does a stack of 5 plastic rings sit on the striped press bed, orange, yellow, blue, pink, green from the bottom, with a yellow duck on top?\n4. Does the press head move down onto the duck and flatten it out to the left, then the rings squash down and tilt over sideways?\n5. In the final frame, has the press head come far down with the stack squashed flat, and are the green and the pink ring no longer visible?\n6. In the final frame, is the bottom orange ring pressed out wide and bulging sideways past the rest, with the duck squeezed out flat to the left?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "wisa_80k_43_viscous_maple_syrup", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a stack of pale pancakes on a white plate? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the syrup stay on top of the pancakes and run down their edges without passing through them or through the plate, with the stack never moving?\n3. In the first frame, does a stack of 5 pale pancakes with a pat of butter on top sit on a white plate, with no syrup on them anywhere?\n4. Does the dark syrup pour out of the bottle at the top right onto the top pancake next to the butter, pool across the top and then creep down over the edges of the pancakes to the plate?\n5. In the final frame, is the top pancake coated in a glossy brown layer, with syrup run down the front of the stack into a dark puddle on the plate?\n6. In the final frame, is the falling stream much thinner than in the middle of the clip and still hanging together as one thread, without breaking into drops?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "wisa_80k_44_metal_spoon_splitting", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 5 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a round dark chocolate cake on a white plate? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. In the first frame, does the metal spoon come in from the bottom with its bowl pressed into the right side of the cake, a thin dark crack running up from it?\n3. Does the metal spoon push into the right side of the cake and drag to the left so the crack opens wider and the molten chocolate inside runs out, then lift out to the top left?\n4. In the final frame, is the cake torn open along a crack from the middle of the top down to the bottom edge, the gap widest at the bottom with rough crumbly broken edges?\n5. In the final frame, is the gap filled with shiny molten chocolate that has run down and pooled at the bottom of the cake, with the spoon gone from the frame?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "wisa_80k_45_sugar_cubes_falling", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a mound of white sugar? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Do the cubes stay whole when they hit and only dent the surface and knock grains loose, without sinking through the mound?\n3. In the first frame, is a mound of loose white sugar made of fine individual grains in the middle of the frame with a clean peak and nothing on top of it?\n4. In the first frame, is one white sugar cube falling above the peak, cut off by the top edge of the frame, with fine grains raining down on the right side?\n5. Do the sugar cubes drop onto the peak one after another, spraying loose grains sideways and tumbling down the left slope out of the frame?\n6. In the final frame, is one sugar cube left sitting on the peak, tilted and half sunk into the loose sugar?\n7. In the final frame, is the peak no longer a clean cone, with a step and a dent in it left of the cube and no other cubes left on the mound?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "wisa_80k_46_wooden_pestle_crushing", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a tall glass filled with brown bread sticks? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. At any point, do crumbs go over the rim of the glass, or does the pestle pass through the glass wall?\n3. In the first frame, is a tall glass filled to the rim with brown bread sticks, with the wooden pestle not yet in frame?\n4. In the first frame, are the sticks solid blocks with sharp edges and rough porous sides, leaning on each other with gaps between them?\n5. Does the wooden pestle come down into the glass and pound the sticks again and again, breaking them into smaller pieces so the level sinks with every stroke?\n6. In the final frame, is the pestle out of frame and the glass only about half full, with the level far lower than at the start?\n7. Does the material in the cup flatten out on the very first push?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "wisa_80k_47_lego_pneumatic_engine", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a grey lego frame with yellow pneumatic cylinders? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. At any point, do the grey frame or the base plate move, or do the hoses pass through the frame or each other?\n3. In the first frame, do three yellow pneumatic cylinders hang in a row along the top of the grey lego frame, black caps down, with black air hoses looping between them?\n4. In the first frame, does the clear air tube run off the right edge of the frame, with the source of the air not visible?\n5. Do the three blue connecting rods stroke up and down one after the other and turn the crankshaft at the bottom, the cycle repeating about six times at a steady speed?\n6. In the final frame, is the engine back in almost the same pose as the first frame, with the three blue connecting rods at the same heights and nothing come apart?\n7. In the final frame, do the black hoses hang in the same loops as at the start, bent the same way and not pulled straight or stretched?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "wisa_80k_48_bullet_shattering_glass", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 8 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a row of clear glass panes? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does any pane crack or move before the white spray reaches it?\n3. In the first frame, do seven clear glass panes stand upright in a row on a wooden beam seen almost edge on, with the leftmost one cut off by the left edge?\n4. In the first frame, is any of the panes cracked, or is the bullet in the frame?\n5. As the bullet goes through each pane, does that pane break into fine glass grains around the hole?\n6. Is the bullet never seen, with only a white spray at mid height moving left to right punching through the panes one after the other, damage spreading sideways after it passes?\n7. In the final frame, are the four panes on the left broken and the three on the right still clear, with none of the panes tipped off the beam?\n8. Does a semi-transparent cloud drift through all the panes without breaking up?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "wisa_80k_49_cylinder_driving_flywheel", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a yellow cylinder between grey lego beams? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. At any point, does the yellow cylinder or the piston rod pass through the grey beams?\n3. In the first frame, does a yellow cylinder stand almost upright between the grey lego beams, with no silver piston rod sticking out of its black top cap?\n4. In the first frame, is the black tire on the left already spinning, with its spokes smeared into a blur?\n5. Does the piston rod slide out of the yellow cylinder and back in again while the cylinder rocks side to side on its bottom joint and the black tire keeps turning?\n6. In the final frame, has the yellow cylinder tilted over to the left, with the silver piston rod out of the black cap and reaching up to the grey arm above it?\n7. In the final frame, can the single spokes of the tire be made out, instead of being smeared like in the first frame?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "wisa_80k_50_bottle_geyser_erupting", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a dark bottle of brown liquid? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the bottle move or tip in the clamp, or does liquid pass through the glass instead of leaving only through the open neck?\n3. In the first frame, is a dark bottle upright, clamped between grey blocks in a wooden holder, with dark brown liquid filling it into the neck?\n4. In the first frame, is the red cap tilted just above the neck with a thin brown spray under it, and the red ring still on the neck?\n5. Does the cap pop off and fly up to the left as a jet shoots straight up out of the neck, narrow and dark brown at first, then wider pale frothy foam?\n6. In the final frame, is the bottle still upright in the same clamp, with the neck full of pale foam and no dark liquid standing in it?\n7. In the final frame, does a frothy tan column come out of the neck and run off the top of the frame, with the red cap cut off at the far left edge?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "B_01", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 11 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a blue ball and a tower of planks? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the tower start to fall before the ball hits it?\n3. Do any of the tower planks pass through one another?\n4. In the first frame, is a blue ball sitting on the floor on the left side of the image?\n5. In the first frame, is there a tower made of colorful planks to the right of the ball?\n6. In the first frame, is the topmost plank of the tower teal?\n7. Does the blue ball move towards the tower and crash into its bottom support planks, toppling it over?\n8. Does the tower fall apart piece by piece rather than all at once?\n9. In the final frame, is any plank still standing upright?\n10. Do the planks move as individual rigid objects, rather than as groups of planks stuck together?\n11. In the final frame, is the blue ball still in frame and not touching any of the planks?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "B_02", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 9 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a wine glass? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. As the poured wine hits the glass, does it churn around?\n3. In the first frame, is a corner of the bottle visible?\n4. In the first frame, is a wine glass sitting on the table?\n5. As the bottle tips, does wine pour out of it?\n6. Is the wine visible through the glass of the bottle?\n7. In the final frame, is the wine glass roughly half full?\n8. In the final frame, is the wine inside the glass, not on the table and not passing through the glass?\n9. In the final frame, is only the corner of the green wine bottle visible in the top left corner?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "B_03", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 12 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a bowling lane with pins? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does any pin move before the bowling ball or another pin hits it?\n3. Do the pins or the ball pass through the wall behind them?\n4. Do any of the objects sink into the ground?\n5. In the first frame, are there ten pins in the lane?\n6. In the first frame, is a bowling ball visible?\n7. In the first frame, is there a half-tube like chute on each side of the bowling lane?\n8. In the first frame, is there a gray wall behind the lane?\n9. As the bowling ball hits the pins, do they fall down?\n10. In the final frame, is exactly one pin still standing?\n11. In the final frame, is exactly one pin still on the wood of the lane?\n12. In the final frame, are any pins lying on the tiles around the lane?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "B_04", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 21 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a ball or a sloped ramp? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. In the final frame, do any of the fallen cubes overlap or sink into one another?\n3. As the gold ball hits the gray cube, does the cube fall apart?\n4. Does the ball pass through the gray cube?\n5. Do any bricks start moving before the ball reaches them?\n6. In the first frame, is a gold ball resting on top of the incline?\n7. In the first frame, is there exactly one gold ball, and is it at the top of the ramp?\n8. Is the gray block built out of small bricks rather than one solid piece?\n9. In the first frame, are any bricks lying on the floor?\n10. In the first frame, is anything other than the block on the brown plinth?\n11. Does the gold ball hit the gray cube?\n12. Does the gray cube fall apart into many smaller gray cubes?\n13. Do some of the smaller gray cubes fall off the green-ish box?\n14. Do the bricks fall to the floor and stay there, without bouncing back onto the plinth?\n15. In the final frame, are the fallen cubes on the floor separated from one another, with floor visible between them?\n16. In the final frame, is every cube on the floor touching at least one other cube?\n17. In the final frame, has the gold ball come down onto the ground and out of view?\n18. In the final frame, has the gray cube fallen apart into many smaller cubes?\n19. In the final frame, are some small gray cubes on the ground to the left of the big cube?\n20. In the final frame, is more than half of the gray block still standing?\n21. In the final frame, is the brown plinth in the same place it started?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "B_05", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like two red curtains on a gold bar? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. At any point, do the flaps of the curtains pass through each other?\n3. In the first frame, is a gold bar attached to the wall with a gold ball at each of its ends?\n4. In the first frame, are two flat red curtains of the same color attached to the bar with rings?\n5. Do the two sides of the curtains open and then close again?\n6. As the curtains open, do they fold into creases?\n7. As the curtains open and close, is the inner edge of each curtain straight and vertical, rather than tilted with the top edge ahead?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "B_06", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 10 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a red ribbon hanging in the air? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Are the ribbon folds resting on the folds beneath them, rather than floating above them?\n3. At any point, do the ribbon folds pass through each other?\n4. In the first frame, is there a circular dark marble platform?\n5. In the first frame, is a straight red ribbon hanging over the platform without touching the ground?\n6. As the red ribbon hits the platform, does it buckle up and do the folds stack on each other as more ribbon falls down?\n7. As more ribbon falls, do the folds below it spread out under the weight?\n8. In the final frame, has the red ribbon formed folds that stack on top of itself and spread across the platform?\n9. Are the ribbon folds curved rather than sharply angled?\n10. In the final frame, are the ribbon folds stacked on top of each other without touching the ground for support?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "B_07", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 10 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a white ball and a brown cube? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the cloth bend around the ball and the cube on the table?\n3. Does the cloth pass through the table corners, the white ball or the cube?\n4. In the first frame, are a white ball and a brown cube sitting on a wooden table?\n5. In the first frame, is there a red cloth?\n6. Does a red cloth fall onto the table and cover it?\n7. Does the cloth slide off the right back side of the table?\n8. In the final frame, does the red cloth cover about half of the table?\n9. In the final frame, is the cloth hanging off the right back side of the table?\n10. In the final frame, is the white ball partially visible?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "B_08", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a box of screws under a conveyor belt? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Do the screws and bolts in the box move as more objects fall onto them?\n3. Do any of the screws or bolts in the box move on their own, without anything touching them?\n4. In the first frame, is the edge of the box closest to the camera shorter than the other edges?\n5. In the first frame, are there both screws and nuts or bolts on top of the conveyor belt?\n6. Does the conveyor belt keep moving while more screws and bolts fall into the box below it?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "B_09", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 9 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a glass tank with black edges? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. At any point, does the water pass through the cylinders or the walls instead of bending around them?\n3. In the first frame, is a column of water on the left side of a glass container?\n4. In the first frame, are the edges of the glass container black?\n5. In the first frame, are there three vertical black cylinders inside the glass container?\n6. Does the water column spread out, collide with the pillars and throw up water around them?\n7. Does the water move from the left side to the right side, hit the right wall and splash up it?\n8. In the final frame, is a water splash leaving the container on the right hand side?\n9. In the final frame, is the water surface uneven and moving on the right side, where the water has hit the wall and risen above the container ceiling?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "B_10", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 8 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like an orange dial on a gray disc? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does any ball move without being pushed by the dial or by another ball?\n3. Do any of the balls fall through the edges of the dial?\n4. Does the orange dial rotate counterclockwise?\n5. Does the dial push the balls on top of the disk through the slit in the disk?\n6. In the final frame, is the orange dial close to the opening?\n7. In the final frame, are any balls in the gray disc?\n8. In the final frame, are any balls visible in the frame?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "B_11", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 8 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a clay container of water? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. In the first frame, is the water surface inside a clay container visible?\n3. In the first frame, is a round water droplet above the water surface without touching it?\n4. Does the droplet fall into the water and make the water rise up in a crown shape?\n5. After the crown forms, does a peak of water rise up in the middle?\n6. Does the water splash outward in all directions?\n7. In the final frame, is the droplet inside the water container?\n8. In the final frame, is the surface inside the container uneven?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "B_12", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 5 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a tennis racket? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. At any point, does the tennis ball pass through the mesh of the tennis racket?\n3. Does the tennis racket mesh deform when it hits the ball?\n4. In the first frame, is the racket's handle further from the camera than its net?\n5. In the final frame, is the tennis ball mostly visible and sitting on the right edge of the frame?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "B_13", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 9 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a blue ball inside a glass ball? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the blue liquid collide with the walls of the glass ball?\n3. In the first frame, is there a blue ball inside the glass ball?\n4. In the first frame, is the glass ball sitting on a support on the ground?\n5. Does the blue liquid ball fall down and collide with the inside walls of the glass ball?\n6. Does the liquid inside the ball splash upwards around the walls, then churn around and calm down?\n7. Are the higher velocity parts of the blue liquid colored more brightly?\n8. In the final frame, is the glass ball about a third to a quarter filled with blue liquid-like material made of distinct particles?\n9. In the final frame, is the surface of the blue liquid uneven?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "B_14", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 9 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a white two-level fountain? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the liquid collide with the container walls of the fountain without passing through them?\n3. In the first frame, is a white two level fountain sitting on the floor?\n4. Does the liquid splash out of the top of the fountain?\n5. Does the liquid move downwards and splash over the two levels of the fountain?\n6. Is the liquid transparent?\n7. In the final frame, is there liquid in both of the fountain's level containers?\n8. In the final frame, is liquid coming out from the top of the fountain?\n9. In the final frame, is there liquid on the floor around the fountain?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "B_15", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 9 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a tower of orange blocks? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. In the final frame, are orange cubes scattered in a pile next to the bottom of the ramp?\n3. In the final frame, are there some orange cubes on the bottom part of the ramp?\n4. Do the orange cubes stack on top of each other rather than passing through one another?\n5. Does the orange tower start to fall apart before the ball hits it?\n6. In the first frame, is there a ramp on the left side with a chrome looking ball on top of it?\n7. In the first frame, is there a tall tower made up of smaller orange blocks?\n8. Does the ball roll down the ramp and hit the orange tower?\n9. Does the orange tower fall apart into smaller orange cubes under gravity, with its bottom falling apart first?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "B_16", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 10 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a vertical chrome cylinder? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the candy roll around on the ground?\n3. Does any of the candy levitate above the floor and fly instead of rolling?\n4. In the first frame, is there a vertical chrome cylinder on the floor?\n5. Does the cylinder raise up, with a pile of rigid candy falling out of it?\n6. Does the candy spread out, with some of the candy rolling around?\n7. In the final frame, is the cylinder still in the frame?\n8. In the final frame, is there a pile of candy in the middle of the ground?\n9. In the final frame, is the candy pile left uncontained, with some pieces rolled outwards further away from the main pile?\n10. In the final frame, do the candy pieces stack naturally on top of each other?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "B_17", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 9 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a fortress made of wooden planks? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the structure collapse as the ball hits it or as other wooden pieces hit it?\n3. In the first frame, is there a fortress-like structure of wooden planks with a shorter tower on each of its edges and a tall tower in the middle?\n4. In the first frame, is a corner of the structure the part closest to the camera, rather than an edge?\n5. Does a gold ball roll into the frame and crash into the wooden plank structure, knocking it down?\n6. After the ball hits the structure, do the planks fall to the ground?\n7. In the final frame, are wooden planks lying on the floor, stacked on top of each other in a physically plausible way?\n8. In the final frame, is a ball visible in the scene?\n9. In the final frame, do any wooden planks of the structure stay standing?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "B_19", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 10 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a blue shallow container? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does any water reach the floor by passing through or below the sides of the container, instead of over them?\n3. As the water from the tube hits the water sitting in the tank, does it splash around?\n4. In the first frame, is there a black tube end on the left-side wall?\n5. In the first frame, is there a shallow blue container in the corner?\n6. Does liquid pour out of the black tube and start to fill up the tank?\n7. Does the poured liquid also splash over the sides of the blue container onto the floor around it?\n8. In the final frame, is transparent liquid pouring out of the black tube in an arc?\n9. In the final frame, is the blue container filled with water whose surface is uneven?\n10. In the final frame, is water also flowing on the floor beside the container?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "B_20", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 9 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a flat array of balls? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Do any of the balls pass through the cube?\n3. In the first frame, is there a red cube at the top of the screen?\n4. In the first frame, is there a plane of equally arranged balls below the red cube?\n5. Does the red block fall down and the balls get attracted to the cube as if it were a magnet?\n6. Do the balls get lifted up towards the cube?\n7. Do the balls end up surrounding the cube?\n8. In the final frame, is the red block surrounded by pinkish metallic balls?\n9. In the final frame, are the balls tightly packed around the block, with little to no space between each other?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "B_21", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 11 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a drum full of colourful marbles? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Do the marbles rest on the sides of the drum with no space between them and the drum?\n3. In the first frame, do the marbles in the drum fill less than half its height?\n4. In the first frame, is there an open drum with holes in its sides?\n5. In the first frame, are many round colorful marbles stacked on top of each other inside the drum?\n6. As the drum turns, do the marbles churn around inside it and ride up the drum wall as separate rigid spheres?\n7. Does the drum turn, churning and mixing the marbles like a clothes washer?\n8. Do the marbles roll around and over each other, mixing up their order?\n9. As the drum turns, do some marbles fall out of it?\n10. In the final frame, are the marbles leaning between the left side of the drum and the bottom of the drum?\n11. In the final frame, are there a few marbles on the floor in front of the drum?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "B_23", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a newton's cradle with metal balls? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Do any of the balls move before the swinging ball hits them?\n3. In the first frame, is a Newton's cradle with metal balls sitting on a surface in a neutral position?\n4. Is the left ball lifted and then released?\n5. Does the left ball hit the rest of the balls, after which the Newton's cradle starts to work correctly?\n6. In the final frame, is the Newton's cradle close to a neutral position, with no end ball swung far from the others?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "B_24", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 10 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a triangle of pool balls? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. At any point, do the balls pass through each other instead of colliding?\n3. Does the white ball move before the stick touches it?\n4. In the first frame, are the pool balls on the left formed into a triangle?\n5. In the first frame, are the balls and one of the bars all resting on the table?\n6. In the first frame, is another stick leaning on the right edge of the pool table?\n7. Does the stick hit the white ball, which hits the triangle of balls and makes them roll away?\n8. Do the balls hit the sides of the table, with some falling through the corners onto the ground?\n9. In the final frame, is the white ball roughly in the middle of the pool table?\n10. In the final frame, are most of the balls sitting at the left edge of the table?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "B_25", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a metal bar on a wooden support? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. At any point, does the rope pass through the metal bar?\n3. In the first frame, is a metal bar attached horizontally to a wooden support?\n4. In the first frame, is there a rope on top of the wooden support that is stretched outwards?\n5. In the first frame, is there also a coiled up rope on the floor?\n6. In the final frame, does the rope have a single loop around the metal bar?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "B_26", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 5 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a yellow ball in a catapult? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. In the first frame, is there a metal ball in the air?\n3. In the first frame, is there a yellow ball sitting inside a catapult?\n4. As the metal ball falls on the wooden plank, does the yellow ball get thrown up in an arc and hit the metal ball sitting on the floor?\n5. In the final frame, are both the yellow ball and the metal ball on the floor, with neither touching the wooden plank?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "B_27", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 8 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a white sink? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. At any point, does liquid leak through the sink walls?\n3. In the first frame, is there a white ceramic sink on the floor?\n4. In the first frame, is there water in the sink?\n5. Does the faucet start emitting a current of water that fills up the sink?\n6. As the water hits the sink, does it splash around?\n7. In the final frame, is there still some water in the sink?\n8. In the final frame, is there water on the floor?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "B_28", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 8 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a pit filled with orange shapes? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the liquid splash and move away when it collides with a rigid object?\n3. In the first frame, is there a rectangular pit in a blue floor?\n4. In the first frame, is the rectangular pit filled with orange cylinders of varying sizes as well as squares and cubes?\n5. In the first frame, is there a slit in the far side of the pit with a white line inside it?\n6. Does white liquid run out of the slit in the far side and fill up the pit?\n7. Does the liquid bend and splash around the orange obstacles in the pit?\n8. In the final frame, is the pit almost full of white liquid, with only a few tall cylinders poking out of it?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "B_29", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 9 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a row of tall columns? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Do the elastic objects bounce around as they hit the bars and the plates?\n3. Do the elastic objects bounce off of each other?\n4. In the first frame, are there five columns?\n5. In the first frame, does each column have horizontal rigid golden bars sticking out of its walls?\n6. In the first frame, does each column have downwards slanted plates?\n7. In the first frame, are there elastic objects placed all around?\n8. Do the elastic objects fall down without bouncing back up abruptly?\n9. In the final frame, are the objects sitting on top of each other without passing through one another?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "B_30", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 4 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a tire at the top of a staircase? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. In the first frame, is a deformable tire sitting at the top of a small staircase?\n3. Does the tire roll down the staircase, deforming along the way?\n4. In the final frame, is the tire at the bottom of the staircase and still visible in the frame?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "B_31", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 8 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a glass cup full of marbles? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Do the balls collide with each other in the container?\n3. Do the balls collide with the walls of the container without passing through them?\n4. In the first frame, is there a crank attached to a glass cup full of marbles?\n5. In the first frame, is there an empty metal-like bowl below the glass cup?\n6. Is the cup turned over?\n7. In the final frame, is the glass cup empty of marbles and tilted towards the container?\n8. In the final frame, does the bronze container hold a lot of marbles?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "B_32", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 4 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a gold ball on a ledge? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. In the first frame, are there five alternating ledges on the wall?\n3. In the first frame, is a gold ball on top of the leftmost end?\n4. In the first frame, is there a black container at the bottom?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "B_33", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 3 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a white box and a wrecking ball? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the wrecking ball swing in from the left and hit the smaller blocks off the ground?\n3. In the final frame, is the wrecking ball on the left side of the scattered cubes?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "CK_01", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 8 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a gray block? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. In the first frame, is there a bullet?\n3. In the first frame, is a gray block the only object in the screen?\n4. Does the bullet collide with the side of the gray block and squish under the pressure?\n5. Does the bullet deform as it compresses against the wall?\n6. In the final frame, is the bullet squished against the side of the gray block?\n7. In the final frame, is the surface of the gray block deformed?\n8. In the final frame, is there a small dent in the middle of the crushed bullet?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "CK_02", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 9 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like an orange sand castle? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Is there an impact between the metal ball and the sand?\n3. Does falling sand hit and flow over other sand without too much spacing?\n4. In the first frame, is an orange sand castle made of fine granular material, without clean flat surfaces, sitting on the floor?\n5. In the first frame, is there a metal ball in front of the castle?\n6. As the metal ball hits the castle, do fine sand particles scatter outwards from the impact?\n7. Does the impact collapse the middle of the castle, making the middle towers sag and then deform into a pile of sand?\n8. In the final frame, are the left towers of the sand castle still standing?\n9. In the final frame, has the middle of the sand castle collapsed and flowed into sand mounds rather than sharp angled piles of castle parts?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "CK_03", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 5 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a transparent tube? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. In the first frame, is a transparent tube sitting on the floor?\n3. In the first frame, is a ball visible?\n4. Does the ball fall from the top into the tube and bounce once before falling again and settling?\n5. In the final frame, is a metal-looking ball sitting inside the transparent tube at its bottom?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "CK_04", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like an oreo cookie in a cardboard box? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. At any point, does the cookie pass through the box?\n3. In the first frame, is a single Oreo cookie sitting just above the floor inside a cardboard box?\n4. In the first frame, are all sides of the cardboard box the same height?\n5. When the cookie first hits the ground, does it bounce off without fracturing?\n6. When the cookie hits the ground the second time, does it break?\n7. In the final frame, are the cookie's break edges ragged rather than straight and clean?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "CK_05", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like two carved pumpkins? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. At any point, do the pumpkins pass through the ground or through each other?\n3. In the first frame, are there two carved pumpkins, one sitting on the ground and the other suspended in the air above it?\n4. Does the top pumpkin fall onto the bottom pumpkin, with both deforming and fracturing?\n5. In the final frame, are the pumpkins resting on top of each other, both fractured from the impact with cracks running along their mouth openings?\n6. In the final frame, is the bottom pumpkin more broken than the top one?\n7. In the final frame, is the top pumpkin leaning forward and down toward the ground with its face?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "CK_06", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like two armadillo figures in the air? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. As one sand figure hits the other, do the bodies deform?\n3. In the first frame, are a red and a beige armadillo figure in the air, both made of granular material?\n4. In the first frame, are the two figures facing each other?\n5. Are the two armadillos thrown toward each other, deforming on collision so the two sand collections fall to the ground together?\n6. In the final frame, is there a pile of red and beige sand on the floor?\n7. In the final frame, is the sand pile mixed rather than perfectly separated, with no crater in the middle?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "CK_07", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like two armadillo figures in the air? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. In the first frame, are a red armadillo figure and a beige one that looks made of sand in the air?\n3. In the first frame, are the two armadillo figures facing each other?\n4. Are the red and beige armadillos thrown towards each other, and does the beige one disintegrate into sand on collision?\n5. As the two collide, does the sand armadillo deform around the shape of the red armadillo?\n6. In the final frame, is the red armadillo lying face down on the ground, with sand scattered around it in mounds and some sand resting on top of it?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "CK_08", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a horizontal purple pillar? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. In the first frame, is a horizontal purple pillar fixed between two supports?\n3. Do the ends of the bar turn so the purple bar twists and deforms, and once it deforms too much do the two ends tear?\n4. Do the two ends tear unequally and at different times?\n5. In the final frame, do the left and right supports hold broken off ends of a deformable purple bar, not a black one?\n6. In the final frame, is a blob from the middle of the purple bar resting on the bottom between the supports, behaving like thick goo?\n7. In the final frame, are the break surfaces of the ends ragged rather than clean?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "CK_09", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like two dragon-like figures in the air? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Do the objects deform on contact without passing through each other?\n3. In the first frame, do the middle two objects look like dragons with their backs turned towards each other?\n4. Do the green dragons fly to the right and the orange ones to the left, colliding?\n5. As the objects collide, do the orange ones deform like putty around the green dragon, with some pieces breaking off and flying away?\n6. In the final frame, are the orange objects deformed, with some pieces of them flying off towards the left side of the screen?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "G_01", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 4 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like an anchor hanging on a chain? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. In the first frame, is an anchor hanging on a chain off a roller?\n3. Is the chain rolled up on top of the roller, pulling the anchor up with it as it swings left and right?\n4. In the final frame, is the chain the anchor is attached to wrapped a few times around the roller on top of the platform?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "G_02", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a gold ball on a chain mesh? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the ball pass through the chain net rather than resting on top of it?\n3. In the first frame, is there a chain mesh made of visible links that are not passing through one another?\n4. Is the ball dropped while the chain mesh links also fall under gravity, draping like a cloth but with individual links moving around?\n5. Do the chain links move as individual rigid objects, so the mesh does not behave like a smooth cloth?\n6. In the final frame, has the chain mesh sagged under gravity, with the gold ball sitting in it?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "G_03", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 8 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a long metal plate resting on a spring? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. As the plate is pressed, do both objects beneath it deform?\n3. In the first frame, is a long metal plate resting on a spring on the left and a clay-like column on the right?\n4. In the first frame, is the metal plate roughly horizontal with the ground and not passing through either object it rests on?\n5. Does a robotic hand press the metal bar downwards, compressing the spring and the clay column?\n6. After the robot arm moves away, does the spring jump back to its original shape while the clay does not return?\n7. In the final frame, does the clay column bend around the corner of the metal bar?\n8. In the final frame, does the clay column also bend outwards?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "G_04", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 11 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a tall column of sand? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. As the sand current hits the fans, is it broken up and thrown apart as it falls to the ground?\n3. Does the sand pass through the fans?\n4. In the first frame, is the sand column touching any of the fans?\n5. In the first frame, are four fans attached to the pillar, alternating left and right at different heights?\n6. In the first frame, is there an orange barrel at the left side of the frame?\n7. Does the sand hit the fans and move them?\n8. Does the sand bounce off the fans and fail to stay one coherent current as it falls to the floor?\n9. In the final frame, are there multiple uneven piles of sand below the fans and the pillar?\n10. In the final frame, is sand spread on the floor in lumps, with some of it reaching the barrel on the left and the wall on the right?\n11. In the final frame, is the sand still flowing?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "G_05", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 8 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a glass container of green liquid? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the liquid pass through the walls of the tube it is flowing through?\n3. In the first frame, is there a glass container at the top filled with green transparent liquid?\n4. In the first frame, is all of the liquid in the top container?\n5. Does the liquid from the top container flow through the tube into the bottom container over time, rather than all at once?\n6. In the final frame, is most of the liquid in the bottom container, with some still in the tube and the top container?\n7. In the final frame, is liquid flowing out of the tube onto the container below it?\n8. Is the green liquid transparent?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "G_06", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 9 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a glass container with metal edges? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the red cube change how it moves before it reaches the water surface?\n3. In the first frame, is there a glass container with metal edges?\n4. In the first frame, is there a box of liquid inside the container?\n5. In the first frame, is there a red cube above the liquid?\n6. As the water box falls, does it hit the container walls and splash upwards, reaching the top of the container?\n7. Does the red cube fall down and hit the water surface?\n8. In the final frame, has the liquid settled in the glass container, with the red cube floating half out of it?\n9. In the final frame, is the settled liquid touching the sides of the container?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "G_08", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 11 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like two cupcakes with pink wrappers? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the nozzle pass through the cupcake?\n3. Does the frosting come out of the bottom of the nozzle?\n4. In the first frame, are there two cupcakes with pink wrap on the table?\n5. In the first frame, is there a dark-gray nozzle on top of the cupcake?\n6. In the first frame, are there a few crumbs on the floor around the cupcake?\n7. Does the frosting nozzle move in a circular motion and emit frosting onto the cupcake?\n8. As more frosting is pushed out, does it stack on top of the existing frosting?\n9. In the final frame, is there pink frosting standing on top of the cupcake in a spiral-like shape?\n10. In the final frame, does the frosting have a vertical spike at the top?\n11. In the final frame, is the nozzle still visible in the frame?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "G_09", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 8 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a blue bunny under a hydraulic press? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the bunny deform before the press touches it?\n3. In the first frame, is a blue Stanford bunny mesh sitting below a hydraulic press with orange-black stripes?\n4. In the first frame, is the bunny a Stanford bunny rather than some other bunny?\n5. Does the hydraulic press move down and squeeze the bunny, making it deform into a disk?\n6. After the hydraulic press raises back up, does the bunny undeform back to its original shape?\n7. Do the ears deform first, on their own, before the rest of the body?\n8. In the final frame, has the bunny returned to a non-deformed state, the same as the original, like an elastic object?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "G_10", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a gray cloth over a black sphere? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the cloth bounce back up after it hits the sphere the first time?\n3. In the first frame, is there a black sphere on a wooden floor with a gray-ish cloth on top of it?\n4. In the first frame, is exactly one cloth visible?\n5. Do five cloths fall onto the rigid sphere on the ground and cover it, bending on top of each other without passing through each other?\n6. In the final frame, have all the cloths settled and bent around the sphere on the ground?\n7. In the final frame, is the top cloth green, with the yellow one below it and then the rest?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "G_11", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 4 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a soft round object or upright metal blades? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the toy octopus drop onto the knives so its articulated tentacles rest on top of the knives?\n3. In the final frame, is the octopus resting on top of the blades with its tentacles resting across the blades?\n4. In the final frame, do the tentacles bend around the knives rather than staying straight or passing through the knives?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "G_12", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 5 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like two flat sheets of paper? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the paper bend as one side of the press rotates over it?\n3. In the first frame, are two straight, non-bent pieces of paper lying flat, one blue and one white?\n4. Does the paper press rotate and fold the two sheets of paper over, then retreat back?\n5. In the final frame, does the white paper sheet stay folded with a sharp crease while the blue sheet has returned to its original shape?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "G_13", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a funnel filled with material? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. As more material pours from the funnel onto the material already on the table, does it stack on top of it and bend?\n3. In the first frame, are there four funnels filled with material?\n4. Do the materials pour from the funnels onto the table and bend like viscoplastic material on top of each other?\n5. Does the leftmost material finish pouring fastest and the rightmost material the slowest?\n6. Is the leftmost material the least viscous and the rightmost material the most viscous?\n7. In the final frame, have all four materials poured from the funnels onto the table, forming goop piles?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "G_14", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 9 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a metal funnel above a conveyor belt? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the conveyor belt move to the right?\n3. Does the white material bend naturally as it hits the conveyor belt?\n4. In the first frame, is there a conveyor belt?\n5. In the first frame, is there a metal funnel above the conveyor belt?\n6. Is white material extruded from the metal funnel, and as it hits the moving conveyor belt does it bend under its own weight and the incoming material into uneven folds?\n7. Are the neighboring folds touching each other and uneven?\n8. In the final frame, has the white material folded into many folds on top of the conveyor belt?\n9. In the final frame, do the different folds of the material touch each other and differ from one another rather than all being the same?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "G_15", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a metal nozzle? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Do the different parts of the cream material float on top of each other without pressing on each other and deforming?\n3. In the first frame, is there a metal nozzle at the top of the frame?\n4. Is white material extruded from the nozzle, and does that material pile up on the table by folding on top of itself?\n5. As more material is added to the table, does the material below deform and the stack topple?\n6. In the final frame, is a bunch of shaving-cream-like thin paste stacked in uneven coils on the table?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "G_16", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a round dough on a wooden board? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Do the robot hands pass through the metal plate?\n3. In the first frame, is there a round dough on top of a wooden board with a metal plate on top of the dough?\n4. Does the metal plate first fall onto the dough, deforming it a bit?\n5. Do two robotic hands later press the metal plate downwards, squishing the dough into a disk?\n6. In the final frame, has the dough ball been pressed into a flat disk, with the metal plate resting on top of it?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "HM_01", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a gold cat statue? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. At any point, do the gold and pink objects pass through each other?\n3. At any point, does the gold or pink object pass through the trampoline?\n4. In the first frame, is the gold cat statue above the pink toy, with neither touching the trampoline?\n5. As the pink and gold objects hit the trampoline, does its top bend like a tightly stretched cloth, making them jump around on it?\n6. As the pink object hits the trampoline and bounces off, does it wiggle around like an elastic object?\n7. In the final frame, have the gold and pink objects settled on top of the trampoline, bending it?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "HM_02", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 8 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like one or more flat platforms? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Do the platforms bend under the weight of the material?\n3. In the first frame, are three platforms suspended at different heights inside a dark vertical chamber, with a green tube on top?\n4. Is a viscous colorful material emitted from the top tube, folding onto itself in coils as it hits the first platform?\n5. Do the platforms bend as material falls on top of them?\n6. Does the viscous material first fold onto itself in coils and then fall apart into granular material?\n7. In the final frame, is some material still sitting on top of the topmost platform?\n8. In the final frame, does the material look like colorful granular material, with most of it on the floor and the bottom platform?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "HM_03", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 8 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a beige statue held by a metal gripper? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the gripper raise up as it twists?\n3. In the first frame, is a beige statue sitting on a metal platform, grabbed on top by a three-sided gripper?\n4. In the first frame, is the statue sitting straight up with the grippers grabbing its head from the sides?\n5. Is the top of the statue rotated and lifted upwards so that it deforms and twists?\n6. After the statue is released, does it untwist and oscillate around its original shape before returning to it?\n7. In the final frame, is the statue back in its original shape?\n8. In the final frame, is the three-sided gripper still touching the statue's head?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "HM_04", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a roasted turkey on a black tray? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the dispensed brown sauce stack over the turkey and rest on it rather than levitating above it?\n3. In the first frame, does a roasted turkey sit on a black tray beneath a sauce dispenser?\n4. Is thick brown gravy poured onto the turkey, flowing over it in strips?\n5. Is the thick brown gravy extruded onto the turkey in column-like strips rather than flowing like a liquid?\n6. In the final frame, is the turkey covered in thick brown sauce dripping onto the tray?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "HM_05", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 5 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a clear disc upright in a press? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the wheel bend before the press touches it?\n3. In the first frame, is a clear metal circular disc standing upright between the plates of a hydraulic press?\n4. In the final frame, has the press crushed and bent the disc into a taco like shape?\n5. In the final frame, does the disc bend outwards from the point where it is pressed?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "HM_06", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a chain of blue and brown links? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. At any point, do the alternating links pass through each other?\n3. In the first frame, is a chain of alternating blue and brown links stretched between two machines?\n4. Are the left and right metal rings pulled apart and rotated in opposite directions, which twists and deforms the blue links?\n5. In the final frame, is the chain pulled tight with its sides rotated in opposite directions, twisting and deforming the blue elastic links?\n6. In the final frame, are the brown links undeformed?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "HM_07", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like two discs joined by coloured rods? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. As the bars are twisted, are they pressed tightly together?\n3. In the first frame, are colorful vertical rods with rigid white balls inside them attached at their ends to circular discs?\n4. Does the top disc twist and lift, twisting the bars tight into a helix until they break at the top attachment?\n5. After the bars twist and break, do they bend downwards and bounce around on the floor?\n6. In the final frame, are the rods torn from the top disc, bent and lying on the floor with the white balls still attached to them?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "LI_01", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a grid of elastic rods? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. As the green object falls onto the rods, do the individual rods move and deform?\n3. In the first frame, is a square pit in the ground covered by elastic rods arranged in a grid pattern?\n4. Does an elastic armadillo figure fall face down onto the grid of rods, and do the rods deform under the armadillo?\n5. In the final frame, has an elastic armadillo fallen on top of the elastic rods with its hands poking through between the rods?\n6. In the final frame, are the rods pushed apart where the armadillo's hands poke through?\n7. In the final frame, are the rods stretched downwards where the armadillo lies?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "LI_02", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 9 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a row of hanging square cloths? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. At any point, do the different cloths pass through each other?\n3. At any point, does the black sphere pass through the cloths?\n4. Does any cloth deform before the black sphere reaches it?\n5. In the first frame, is there a gradient of square cloths hanging, with a black sphere sitting behind the leftmost cloth?\n6. As the black sphere moves through the cloths, do they bend around it, collide with each other, and then start to swing?\n7. Do the cloths bend around the sphere like soft material?\n8. In the final frame, is the black sphere still visible?\n9. In the final frame, are the cloths wrinkled and mid swing?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "LI_03", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 5 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a spiral of upright dominoes? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. In the first frame, are dominoes arranged upright in a large circular spiral on a wooden floor, with one white domino falling toward the line?\n3. As the white domino hits the first purple domino, do the dominoes start to topple over?\n4. In the final frame, are the colorful dominoes knocked over in a large oval pattern on the wooden floor?\n5. In the final frame, do the dominoes form a perfectly circular spiral, with none of them rotated outwards?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "LI_05", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 8 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a flat blue cloth hanging in the air? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. In the first frame, is a flat blue cloth hanging in the air at a tilt, covering the right half of the image?\n3. In the first frame, is a helicopter behind the cloth, with only its nose and one rotor blade sticking out on the left?\n4. Does the flat blue sheet fall down onto the helicopter?\n5. As the sheet drapes over the helicopter, does it take on the shape of the fuselage and the fan?\n6. Does the cloth end up on the floor next to the helicopter, with the helicopter staying in the same place the whole time?\n7. In the final frame, is the helicopter uncovered, with no blue cloth on it?\n8. In the final frame, is the blue cloth one crumpled piece lying on the floor in the bottom right corner?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "LI_07", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 9 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a yellow armadillo figure on black rollers? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. At any point, does the armadillo pass through a roller instead of being pinched between two of them?\n3. In the first frame, is a yellow armadillo figure standing upright on top of a row of black rollers?\n4. In the first frame, is there a yellow motor on the left driving a small silver gear that meshes into the gear row?\n5. In the first frame, does the top half of the armadillo go out of the top of the frame?\n6. In the first frame, are two levels of rollers visible, six rollers in total?\n7. Does the armadillo fall onto the turning rollers, with its legs pulled into the rollers and its body squeezed through?\n8. In the final frame, is any part of the armadillo still sitting on top of the rollers?\n9. In the final frame, is the only yellow left of the armadillo a few patches in the gaps between the rollers and under them?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "LI_08", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 9 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a teal chain hanging from a hook? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does each link stop dropping only when it pulls tight against the link above it?\n3. At any point, do the links pass through each other?\n4. In the first frame, is a teal chain hanging from a metal hook on the ceiling?\n5. In the first frame, does the bottom link hang in the air without reaching the floor?\n6. Does the chain fall open under gravity, with the links stretching apart starting at the top and going downwards?\n7. Does the chain pull back up and bob up and down with smaller and smaller amplitude?\n8. In the final frame, are the links pulled apart, each link hooked only into the one above and the one below it?\n9. In the final frame, is the chain longer than in the first frame, with the bottom link sitting lower on the wall?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "LI_09", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 8 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a group of straight parallel rods? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Where the rods press on each other, do they wind around and stay on the outside, with no rod passing through another?\n3. In the first frame, are there four straight rods spanning between two dark discs?\n4. In the first frame, are the rods untwisted and unbent, running parallel to each other?\n5. Do the ends of the ropes rotate in opposite directions and the rods first bow outwards into four loose helical waves?\n6. Do the rods then come together in the middle and form a tight twisted rope that grows outwards towards both ends?\n7. In the final frame, are all four rods twisted together into one single rope?\n8. In the final frame, is the twisted bunch the same thickness all the way along, except right next to the ends where the individual rods stretch out to their attachments?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "ML_01", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 10 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like two metal pipes bent toward each other? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Where the two jets meet, do they spread sideways into a wide flat sheet with the beige grains mixed into the clear liquid?\n3. In the first frame, are there two metal pipes coming down from the top of the frame, both bent so they point at each other?\n4. Does a clear liquid jet shoot out of the left pipe and a beige granular jet shoot out of the right pipe at the same time?\n5. Do the two jets meet in the air near the middle of the frame and flatten into a sheet that falls downwards?\n6. Does the water jet bend above and around the point where it hits the granular jet?\n7. In the final frame, is there exactly one puddle on the floor, in the middle of the frame?\n8. In the final frame, is the puddle transparent liquid with beige grains spread across it?\n9. In the final frame, is a jet coming out of either of the two pipes?\n10. In the final frame, does the puddle reach the back wall?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "ML_02", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a tall cylinder of tan grains? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Do the grains start moving where the disc pushes into them and get shoved sideways and outwards?\n3. In the first frame, is a tall cylinder made out of small tan grains standing on a round metal disc?\n4. In the first frame, is a beige cylinder lying on its side on the right side of the dark platform?\n5. Does the top metal disc press down and squash the grain cylinder?\n6. In the final frame, are there two piles of spilled grains on the platform, one on each side of the bottom disc?\n7. In the final frame, have any grains fallen off the edge of the dark platform?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "ML_03", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 9 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a glass cylinder full of coloured grains? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Do the noodles stack on top of each other without sinking into each other?\n3. In the first frame, is a glass cylinder with a dark rim hanging in the air above a grey floor?\n4. In the first frame, is the cylinder full to the top with a rainbow coloured granular material, purple and blue on top, green in the middle, red at the bottom?\n5. Does the piston push down into the cylinder and squeeze the material out through holes in the bottom of it?\n6. Do the first strands come out red and hang straight down, reaching the floor only later?\n7. As a strand lands, does its tip buckle and coil, with the noodles stacking up into a pile under the cylinder?\n8. In the final frame, is the cylinder only about half full, with the material left in it blue on top and red at the bottom?\n9. In the final frame, is there one single pile of noodles on the floor under the cylinder and no loose noodle pieces anywhere else?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "ML_04", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 9 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a snowman made of stacked snowballs? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. In the first frame, is there a snow ball on the slope?\n3. In the first frame, is there a snowman made of three stacked snow balls on the flat part at the bottom of the slope?\n4. As the boulder moves down, does more snow stick to it while it plows the snow and leaves a track behind it?\n5. At the bottom of the slope, does the boulder run into the snowman and stop against its bottom ball?\n6. At any point, does the snowman topple over?\n7. In the final frame, are all three snow balls of the snowman still stacked on top of each other, with none fallen off?\n8. In the final frame, is the snow boulder at the bottom of the slope, touching the bottom ball of the snowman?\n9. In the final frame, is there a track of missing snow where the snowball rolled down?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "PF_01", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a brown wooden bowl? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Do the pillows dent and deform where a monkey head statue presses into them?\n3. In the first frame, is there a brown wooden bowl standing on a wooden floor?\n4. In the first frame, are four monkey heads, a yellow, a blue, a green and a pink one, above the pillows, with the yellow and blue ones highest?\n5. Do the pillows fall into the bowl, with the monkey heads falling on top of them and settling?\n6. In the final frame, are all the monkey heads resting on the pillows inside the bowl?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "PF_02", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 9 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a gold gripper holding a teal ball? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. When the ball hits the cloth, does the top cloth become wrinkled in rings around it?\n3. In the first frame, is a gold two jawed robot gripper at the top of the frame holding a teal ball?\n4. In the first frame, is there a pile of square cloth sheets below the ball?\n5. Does the gripper let go so the teal ball drops straight down?\n6. At the same time, does the pile of sheets sink down and flatten out onto the floor?\n7. Does the ball land on the white top sheet and bounce back up?\n8. In the final frame, is the teal ball in the air above the stack, not touching any sheet?\n9. In the final frame, are all the cloth sheets lying flat, fanned out like a pinwheel?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "PF_03", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 10 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a bundle of pale yellow noodles? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does a strand bend and coil in the part still hanging in the air, away from the bowl and the pile?\n3. At any point, do the noodles pass through each other or through the bowl?\n4. In the first frame, is a dense bundle of pale yellow noodle strands hanging in the air and going out of the top of the frame?\n5. In the first frame, is there an empty wide dark grey bowl with a pale wooden rim below the noodles?\n6. Does the hanging bundle of noodles fall straight down into the bowl?\n7. Do the tips hit the bottom of the bowl and coil up into loops while the rest of the strand keeps feeding down?\n8. Do the coils pile up and spread outwards over most of the bowl?\n9. In the final frame, is the bowl full of noodles that all lie coiled flat, with none standing upright?\n10. In the final frame, is any noodle lying outside the bowl?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "PF_04", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 12 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a house of cards? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the card house start to fall before the ball touches it?\n3. Does the ball pass through the cards rather than pushing them over?\n4. In the first frame, is a house of cards eight rows tall standing on a green felt table?\n5. In the first frame, is the topmost triangle made of two red backed cards?\n6. In the first frame, is a ball in the frame?\n7. Does a red ball fly in from the left, land on the table and roll into the bottom left corner of the card house?\n8. Do the bottom left cards give way first, with the rows above them falling down after?\n9. Do the upper rows slide down towards the left and form a slope of cards down to the table?\n10. Does the ball bounce back off the cards and roll back to the left?\n11. In the final frame, has the left half of the card house collapsed?\n12. In the final frame, is exactly one card lying flat on the table to the right of the card house?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "PF_05", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 10 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a green frame holding white rods? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. At any point, do the orange figures pass through the rods or through each other?\n3. In the first frame, is a bed of white deformable rods stretched flat across a green metal frame?\n4. In the first frame, is only one orange figure in the frame, above the rods and mostly cut off by the top edge?\n5. Do the three elastic armadillo figures fall onto the rod bed one after the other, with the lowest one landing first?\n6. Do the rods stretch and sag down under each figure as it lands?\n7. Do the figures bounce on the cables and slide apart into a row?\n8. In the final frame, are three orange armadillo figures lying on the rods?\n9. In the final frame, is any of the three figures standing upright instead of lying on its back or front on the rods?\n10. In the final frame, do the cables sag under the three figures?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "PF_06", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 9 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a wide strap coiled into loose loops? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the strap bend around the metal ring where it touches it and slide over it as it tightens?\n3. In the first frame, does a wide strap run from the bottom left up to a silver ring bolted onto the wall, formed into a knot that is not tight?\n4. In the first frame, is the strap coiled into loose open loops in front of the ring, with the yellow end threaded through the ring?\n5. Do the loose loops pull tight one after the other, the ones closest to the clamp first?\n6. Do the remaining loops slide along the strap towards the ring and cinch into one small knot against it?\n7. While the strap is being pulled, does it keep twisting and waving along its free length?\n8. In the final frame, are the loose loops gone, with one tight knot left sitting on the left side of the silver ring?\n9. In the final frame, is the rest of the strap pulled straight with some twists in it, and off the floor?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "PF_07", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 5 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a row of small figures? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. In the first frame, are four armadillo figures placed in the air in a row near the top of a wide grey concrete ramp that slopes down towards the camera?\n3. Do the red and the yellow figure barely move and stop near the top, while the teal one keeps creeping and the blue one slides fastest?\n4. In the final frame, are only three figures left in the frame, with the blue one gone?\n5. In the final frame, are the red and the yellow figure still at the top of the ramp, close to where they started?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "PF_08", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 10 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a grey robot arm holding a blue ball? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. At any point, does the cone poke through the pink cloth?\n3. At any point, do any of the cloths pass through each other?\n4. In the first frame, is a grey robot arm standing on a concrete block, with its gripper holding a light blue ball?\n5. In the first frame, right of the arm, is a stack of square cloth sheets floating above a metal cone in the middle of a grey platform?\n6. Does the whole stack of cloths drop down onto the metal cone and drape over it?\n7. After the cloths settle, does the gripper open and let the blue ball fall onto the draped cloth and bounce back upwards?\n8. In the final frame, are all the cloths draped over the cone?\n9. In the final frame, is any part of the metal cone still visible?\n10. In the final frame, is the light blue ball in the air above the cloth cone and touching nothing?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "PF_09", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 9 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a purple knotted tube? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the knot flatten only where the cylinders pinch it, with the rest of it keeping its thickness?\n3. In the first frame, is a purple knotted tube shape hanging in the air above a grey plate mounted on the wall?\n4. In the first frame, does the plate hold four copper coloured cylinders seen end on, in a 2x2 grid?\n5. In the first frame, is the purple knot much wider than the gap between the two upper cylinders?\n6. Does the knot fall onto the two upper cylinders and get drawn into the gap between them?\n7. After the knot leaves the cylinders, does it swell back up, drop to the floor and settle there?\n8. In the final frame, is the purple knot lying on the floor below the plate and not touching the cylinders?\n9. In the final frame, is the knot one single piece that has not torn into multiple pieces?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "S_01", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 10 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a black ramp with beige cereal rings? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Do the floating rings shove each other sideways without passing through each other or the sink walls?\n3. In the first frame, does a black ramp come in from the top right and end just above a white rectangular sink?\n4. In the first frame, are beige ring shaped cereals standing on their edge on the ramp, in two rows next to each other?\n5. In the first frame, is the white sink about half full of still water with a flat water surface?\n6. Do the cereals slide down the black ramp towards the sink?\n7. As each ring reaches the water, does it dip into the surface, bob back up and stay floating flat?\n8. Do the floating rings get pushed away from the landing spot towards the left side of the sink until the ramp is empty?\n9. In the final frame, is all the cereal floating on the water surface, with none of it sunk to the bottom of the sink?\n10. In the final frame, is the cereal packed into the left part of the sink, leaving the right third of the water clear?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "S_02", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 11 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a glass tank with yellow rubber ducks? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Do any of the ducks start to move before the water front reaches them?\n3. In the first frame, is a big glass tank with gold corners standing on a dark metal table?\n4. In the first frame, is a tall green column of water standing against the left wall of the tank?\n5. In the first frame, is the rest of the tank floor covered with yellow rubber ducks?\n6. Does the water column collapse, with a water front running along the floor from the left to the right?\n7. Does the front reach the ducks and push them to the right side?\n8. Does the water hit the right wall and run up it, splashing around in thin formations?\n9. Does the wave come back and travel to the left, dragging the ducks back towards the left wall?\n10. In the final frame, is the tall water column gone, with the water covering the whole floor of the tank?\n11. In the final frame, are most of the ducks piled into one clump around the middle of the tank?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "S_03", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like two white tubes pointing at each other? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the water pass through the lower cylinder instead of bending around it?\n3. In the first frame, are there two white tubes pointing at each other, one hanging down from the top of the frame and one standing up from the bottom?\n4. Does water come out of the top cylinder and bridge the gap as a straight vertical column?\n5. Where the column hits the top of the lower cylinder, does the water spread sideways into a flat round disc that grows wider and bends its rim down into a bell around the cylinder?\n6. In the final frame, does the water form one bell shape around the top of the lower cylinder?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "TM_01", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a whole yellow banana? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does any banana piece move apart before the blade touches it?\n3. Is the knife's wooden handle joined to the metal blade?\n4. Does the blade come down into the banana before a piece comes off it?\n5. After the first piece is cut off, does it roll to the side and stay down on the board, with the second piece toppling over to the right?\n6. In the final frame, is every banana piece resting on the cutting board, with none floating above it?\n7. Do the cut pieces separate with a clear gap between their cut faces?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "TM_02", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a green block? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the green block dent only where a cube lands, with the cubes not bouncing back up?\n3. In the first frame, is a green brick shaped block sitting on a grey platform?\n4. In the first frame, are three small cubes, one red, one orange and one blue, floating in the air above the block?\n5. Do the three cubes fall onto the green block, each pushing a dent into it and staying where it landed without rolling away?\n6. In the final frame, are all three cubes resting on top of the green block, with the red one sunk deepest and the blue one least sunk?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "TM_03", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 8 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a white bowl with beige sand in it? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. In the first frame, is there a white ceramic bowl with beige sand in it, the sand surface flat and well below the rim?\n3. In the first frame, does a grey metal tube hang over the back right rim of the bowl with its open end pointing down into the bowl?\n4. In the first frame, is a metal turbine lying in the sand near the middle of the bowl?\n5. Does a thick column of sand pour out of the mouth of the tube and fall?\n6. Does the turbine rotate around the center and spin the sand around the bowl?\n7. In the final frame, is the sand surface uneven?\n8. In the final frame, does a sand column still hang from the mouth of the tube?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "Z_01", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a steak on a wooden cutting board? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the piece torn off the steak stay attached to the mallet?\n3. In the first frame, is a steak lying on a wooden cutting board with two mallets stuck into it?\n4. Does the right mallet move up and to the right, stretching the steak and then tearing a piece off?\n5. In the final frame, has the right mallet pulled upwards with a piece of steak hanging from it as a deformable piece, not a flat board?\n6. In the final frame, is the steak torn into two pieces?\n7. In the final frame, is the steak on the board torn with an uneven, rough tear?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "Z_02", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like an orange tube? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the tube deform and break in half because of the lowering rigid plate?\n3. In the first frame, is an orange tube sitting below a metal plate without deforming?\n4. Does the top plate move down so the top of the tube bends outwards and then fractures down the middle?\n5. In the final frame, has the plate lowered and the tube split down the center into two halves, open on the top facing side?\n6. In the final frame, is the fracture surface of the two ends uneven?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "Z_03", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 9 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a translucent blue armadillo? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the armadillo move on its own, apart from stretching where the clamps grip it?\n3. Does each torn off piece stay held in the clamp that pulled it and keep moving with that clamp?\n4. In the first frame, is a translucent blue armadillo suspended with its hands and feet held by four mechanical grippers?\n5. Do the grippers pull outwards, stretching the armadillo's limbs until they fracture and tear with rough, uneven surfaces?\n6. Do the arms tear before the legs?\n7. In the final frame, have the grippers torn off the armadillo's hands and feet, leaving the torso suspended in the middle, with all parts still visible?\n8. In the final frame, is the left leg torn below the knee?\n9. In the final frame, are the tears uneven rather than clean?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "Z_04", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a piece of bread on a wooden board? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the bread move on its own, apart from stretching as the tongs move?\n3. In the first frame, is a piece of bread with a porous surface sitting on a wooden board?\n4. In the first frame, is the bread gripped by metal tongs on both sides?\n5. Do the metal tongs move outwards and pull the ends of the bread apart, tearing it apart?\n6. Does the top part of the bread tear first?\n7. In the final frame, is the bread torn into two pieces with rough, uneven breaking surfaces?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "Z_05", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 5 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a column of sand in a glass cylinder? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the sand slump out of its cylinder shape while the glass tube is still around it?\n3. In the first frame, is there a column of sand closed within a glass cylinder on the table?\n4. In the final frame, is the glass cylinder gone from the scene, with the sand spread out into a circular pile peaked in the middle?\n5. Is the sand pile made of individual fine grains, with a ragged edge?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "Z_06", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 8 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a glass container with water? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the liquid splash around as it hits the rigid walls?\n3. In the first frame, is the floor of the glass container covered with liquid, with an extra column of water on the left side?\n4. In the first frame, is there a red ball in the air above the water level in the middle?\n5. Does the red ball fall vertically down toward the water surface?\n6. Does the liquid column fall down and start a wave that moves from left to right?\n7. Does the liquid keep moving left and right, moving the red ball as it floats in the water?\n8. In the final frame, is the water splashing around as it hits the right wall?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "Z_07", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 8 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a green jelly dinosaur? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the dinosaur fracture before the bullet travels through it?\n3. As the dinosaur parts fall to the ground, do they slide to the right?\n4. In the first frame, is a jello like green dinosaur standing in the middle of the screen, facing to the left?\n5. In the first frame, is there a bullet on the left side of the screen?\n6. Does the bullet fly from left to right through the dinosaur, making it fracture and move to the right?\n7. In the final frame, do the fractured parts of the dinosaur body lie on the ground like semi-firm deformable jello objects, not like goop?\n8. In the final frame, is the dinosaur body fractured along uneven surfaces?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "Z_08", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 7 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a cooked piece of pork belly? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. At any point, does the top layer of the meat pass through the piece below it?\n3. In the first frame, is there a cooked piece of pork belly on a table?\n4. In the first frame, are two chopsticks holding the corner of the top layer?\n5. Do the chopsticks pull the top layer of pork progressively off the top, with the layer bending as it is pulled off?\n6. As the top layer is torn off, does it wiggle around?\n7. In the final frame, has the top layer been torn off the top of the pork and is it held by the chopsticks?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "Z_09", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 5 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a blue and red bar standing vertically? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Do the rods twist only because the top attachments rotate?\n3. In the first frame, are both vertical bars straight?\n4. After the tops of the bars are twisted and released, does the gold bar stay in the deformed state while the blue rod untwists and oscillates around its original shape?\n5. In the final frame, does the gold bar hold a permanent deformation in the shape of a single turn while the blue one oscillates around its original shape?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "Z_10", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 11 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a green jade statue? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the green object stretch and twist only while the cylinder holds its top, without moving on its own?\n3. Does the bottom of the green object stay stuck to the metal plate the whole time?\n4. In the first frame, is a green jade looking statue sitting on a metal plate on a wooden table, with the top of the green object touching a black-silver cylinder?\n5. In the first frame, is the green object twisted, with a spiral on its surface?\n6. Does the striped cylinder hold the top of the green object and pull it upwards while rotating?\n7. At the same time, does a spiral twist form along the body of the green object?\n8. After it is released, does the green object untwist and sink down only partway, not back to the start shape?\n9. In the final frame, is exactly one green object in the frame, with the striped cylinder gone?\n10. In the final frame, is the green object taller and more rounded than in the first frame, not back to its original shape?\n11. In the final frame, is the object still twisted?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "Z_11", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 9 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a teal disc held between two clamps? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. Does the disc stretch only when its ends are pulled apart?\n3. In the first frame, is a circular teal silicone disc with ring indentations on top held between two clamps, suspended in the air?\n4. In the first frame, is the disc flat and not deformed?\n5. Do the two clamps move apart sideways and stretch the disc into a long thin strand?\n6. Does the middle of the strand sag down towards the table while it is stretched?\n7. Do the clamps let go so the strand recoils and drops onto the table?\n8. On the table, does the strand pull itself back into the round disc shape?\n9. In the final frame, is the silicone back to a flat round disc lying on the wooden table, with the concentric rings on top of the disc visible?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." }, { "scene": "Z_12", "n_frames": 16, "prompt": "These are 16 frames from one video, in order. The first is the video's first frame and the last is its final frame; the rest are sampled evenly from in between.\n\nAnswer each of the following 6 questions about that video. Each is a yes/no question about what is physically visible.\n\n\nThese frames come from a 3D reconstruction that may be incomplete, so an object a question names may be absent from the video entirely.\nIf an object a question asks about is NOT IN THE VIDEO AT ALL, answer 'Missing' for that question.\nMissing is only about objects that are not there. If the objects ARE there but the thing described does not happen, or looks different from the description, that is an ordinary No, not Missing.\nOnly answer Yes or No when you can see the things the question is about.\n\n1. In the first frame, is there something that looks like a whole watermelon? Answer Yes even if it is crude, roughly shaped, or a different colour.\n2. In the first frame, is one whole watermelon in the air, not touching the floor, with nothing else in the scene?\n3. In the first frame, is a round dark shadow on the concrete floor below the melon, a bit to its right?\n4. Does the watermelon fall down onto the gray concrete floor and burst open on impact, with red flesh and green rind shooting up above the impact point?\n5. Do the pieces fall back down and scatter outwards over the floor?\n6. In the final frame, are two big green rind pieces left lying on the floor near the middle, both green side up?\n\nReply with one line per question, in order, formatted exactly as:\n1. Yes\n2. No\n3. Missing\n(and so on). Give no other text." } ]