CSC420 Intro to Image Understanding Assignment 4 – Fall 2019
Post Date: November 19 Due Date: November 28 , 10:59 pm
Stereo Image代写 Instructions for submission: Please write a document in a pdf or doc file with your solutions , and submit through MarkUS.
Instructions for submission: Please write a document in a pdf or doc file with your solutions (include images where needed), and submit through MarkUS. Please include your code and specify the question to which it corresponds.
1.Stereo Matching Costs
a）[0.5 point] Imagine that two images for stereo matching are captured by the same camera but under different exposure times. Compare the two main cost functions for matching, i.e. SSD and NC, for estimating the correspondences in these two images. Which one performs better and why?
2.Stereo Matching Implementation – for this question Stereo Image代写
Use the rectified image pair (000020_left.jpg and 000020_right.jpg), the given bounding box in file 000020.txt, and the given parameters in file 000020_allcalib.txt.
a）[2 points]
Write a program to compute the depth for each pixel in the given bounding box of car. Use the algorithm given in class, where given a left patch, compare it with all the patches on the right image’s scanline. To reduce computation complexity, you can try to use a small patch size, or sample patches (e.g. every other pixel) from scanline instead of comparing with all possible patches. Report what is the patch size, sampling method, and matching cost function you used. Use the parameters given and show how depth is computed for each pixel. Also visualize the depth information. Are there any outliers coming from incorrect point correspondences?Stereo Image代写
b）[2 points]
After you compute depth using scanline (above), go to KITTI Stereo 2015 (http://www.cvlibs.net/datasets/kitti/eval_scene_flow.php?benchmark=stereo),and pick a machine learning model from the scoreboard. You can pick a model that comes with code and a pre-trained model so you don’t need to implement yourself. Compute the depth for the whole image using their pretrained model. Compare your results from the previous questions with this results from this model. What is the difference, both in terms of quality and speed?
c）[1 point] Stereo Image代写
Write a short summary of workflow for the model you pick, e.g. what layers do they use, what modules do they use, etc.
d）[1.5 points]
Using the depth information from models, try to determine within the bounding box, which pixel belong to the car based on its distance to the box center pixel’s 3D location (use a threshold). After that, try to determine a 3D bounding box for the car (min & max along X, Y, Z). Visualize the segmentation of pixels within the 2D box, and on another image visualize the 3D box. State the classification threshold for distance.
3.Fundamental Matrix – for this question Stereo Image代写
Take 3 images (I₁, I₂, I₃) of an object or a stationary scene as follows: Images I₁, I₂ from almost the same viewpoint, but with a (roll) rotation. That is, take an image (I₁), don’t move, but rotate the camera in place around 30-45 degrees, and take anotherimage (I₂). Take the third image (I₃) from a different viewpoint, g. move the camera~20 cm to the right and rotate (out of plane) to point the camera towards the object again.
I₁ and I₂:
I₁ and I₂ (top view):
a）[1 points]
Use SIFT matching (or any other point matching technique) to find a number of point correspondences in the (I₁ , I₂) image pair and in the (I₁ , I₃) image pair. Visualize the results. If there are any outliers, either manually remove them or increase the matching threshold so no outliers remain. Pick 8 point correspondences from the remaining set for each image pair, i.e. (I₁ , I₂) and (I₁ , I₃). Visualize those 8 point matches. It helps in the later steps if the 8 point matches are somewhat distributed over the images rather than being clustered in a small region.Stereo Image代写
b）[1 point]
Using what we have learned in class (standard 8-point algorithm) calculate the fundamental matrix F₁₂ for image pair (I₁ , I₂) and Fundamental matrix F₁₃ for image pair (I₁ , I₃). (for this question, implement your own standard 8-pointalgorithm)
c）[1 point] Stereo Image代写
Using F₁₂, calculate the epipolar lines in the right image for each of the 8 points in the left image and plot them on the right image. (for this question you can use any OpenCV functions you want)
d）[1 point]
Using F₁₂ , rectify I₂ with I1 and visualize the resulting image side by side with I₁. Do the same for I₃ using F₁₃ . (for this question you can use any OpenCV functions you want)
e）[0.5 point] Stereo Image代写
Using OpenCV, compute F’₁₂ and F’₁₃ and compare with your results. I.e. are they same? Are they similar? Briefly discuss.
f）[0.5 point]
Using OpenCV, rectify the images using F’₁₂ and F’₁₃ and compare with your rectifications (part d). Discuss any differences.
更多其他: Case study代写 毕业论文代写 论文代写 prensentation代写 Case study代写 网课代修 代写CS 数据分析代写 润色修改 代写案例 Assignment代写 助学金申请 成品购买
您必须登录才能发表评论。