The generated video is not from the same viewpoint as my depth video.

[kaihekaihe]

I have adjusted the exo camera to a wider angle that can better capture Joker's facial features, while keeping the ego external parameters unchanged in the front part. {

"test_datasets": [
{
"exo_path": "./example/in_the_wild/videos/joker/exo.mp4",
"ego_prior_path": "./example/in_the_wild/videos/joker/ego_Prior4.mp4",
"prompt":"[Exo view]nScene Overview:nThe scene is set on a street in front of a hospital, indicated by the large "EMERGENCY" sign visible in the background. The ground is asphalt, marked with yellow lines, and appears to have debris scattered across it, including small rocks and larger pieces of material. To the left, a gray sedan is parked, partially obscured by smoke. In the background, an ambulance is visible, and smoke billows from the building, suggesting a fire or explosion. The building itself has large glass windows and a beige exterior. A red fire hydrant is positioned on the right side of the frame, and the area is shrouded in a haze of smoke, reducing visibility.nnAction Analysis:nThe sequence begins with a figure standing in the middle of the street, wearing a white uniform with red trim. The figure's hands are initially positioned in front of them, possibly holding an object that is not clearly visible. In the second frame, the figure raises a small metallic object, which appears to be a lighter or similar item, with the right hand while the left hand remains open and slightly raised. The third frame captures a moment of ignition, as flames erupt in the background, indicating an explosion or fire. The figure's hands are now in a more dynamic position, with the right hand holding the lighter and the left hand moving as if reacting to the sudden event. In the final frame, the figure turns away from the explosion, with the left arm extended outward and the right hand still gripping the lighter. The transition from a static pose to a reactionary movement illustrates a shift from calm to urgency, as the figure responds to the unfolding chaos.nn[Ego view]nScene Overview:nThe scene is set on a street in front of a hospital, indicated by the large "EMERGENCY" sign visible in the background. The ground is asphalt, marked with yellow lines, and appears to have debris scattered across it, including small rocks and larger pieces of material. To the left, a gray sedan is parked, partially obscured by smoke. In the background, an ambulance is visible, and smoke billows from the building, suggesting a fire or explosion. The building itself has large glass windows and a beige exterior. A red fire hydrant is positioned on the right side of the frame, and the area is shrouded in a haze of smoke, reducing visibility.nnAction Analysis:nThe sequence begins with a figure standing in the middle of the street, wearing a white uniform with red trim. The figure's hands are initially positioned in front of them, possibly holding an object that is not clearly visible. In the second frame, the figure raises a small metallic object, which appears to be a lighter or similar item, with the right hand while the left hand remains open and slightly raised. The third frame captures a moment of ignition, as flames erupt in the background, indicating an explosion or fire. The figure's hands are now in a more dynamic position, with the right hand holding the lighter and the left hand moving as if reacting to the sudden event. In the final frame, the figure turns away from the explosion, with the left arm extended outward and the right hand still gripping the lighter. The transition from a static pose to a reactionary movement illustrates a shift from calm to urgency, as the figure responds to the unfolding chaos.nnAction Analysis:nThe sequence begins with a figure standing in the middle of the street, wearing a white uniform with red trim. The figure's hands are initially positioned in front of them, possibly holding an object that is not clearly visible. In the second frame, the figure raises a small metallic object, which appears to be a lighter or similar item, with the right hand while the left hand remains open and slightly raised. The third frame captures a moment of ignition, as flames erupt in the background, indicating an explosion or fire. The figure's hands are now in a more dynamic position, with the right hand holding the lighter and the left hand moving as if reacting to the sudden event. In the final frame, the figure turns away from the explosion, with the left arm extended outward and the right hand still gripping the lighter. The transition from a static pose to a reactionary movement illustrates a shift from calm to urgency, as the figure responds to the unfolding chaos.",
"camera_intrinsics": [
[
634.47327,
0.0,
392.0
],
[
0.0,
634.4733,
224.0
],
[
0.0,
0.0,
1.0
]
],
"camera_extrinsics": [
[
1.0,
0.0,
0.0,
0.0
],
[
0.0,
1.0,
0.0,
0.0
],
[
0.0,
0.0,
1.0,
0.0
]
],
"ego_intrinsics": [
[
150.0,
0.0,
255.5
],
[
0.0,
150.0,
255.5
],
[
0.0,
0.0,
1.0
]
],
"ego_extrinsics": [
[
[ 0.0000, 1.0000, 0.0000, -0.0000],
[ -0.8920, -0.0000, 0.4521, -3.0249],
[ 0.4521, -0.0000, 0.8920, -0.9991]
],
[
[ 0.0000, 1.0000, 0.0000, -0.0000],
[ -0.8920, -0.0000, 0.4521, -3.0249],
[ 0.4521, -0.0000, 0.8920, -0.9991]
],
[
[ 0.0000, 1.0000, 0.0000, -0.0000],
[ -0.8920, -0.0000, 0.4521, -3.0249],
[ 0.4521, -0.0000, 0.8920, -0.9991]
]
First, I used render to generate the depth video:

python scripts/render_vipe_pointcloud.py
--input_dir vipe_results/joker
--out_dir render_results
--meta_json_path ../EgoX/example/in_the_wild/meta4.json
--start_frame 0
--end_frame 48
--point_size 5.0
--use_mean_bg.

Here is the generated depth video:

https://github.com/user-attachments/assets/4e3cbf83-d0db-408b-964f-17d4cd45ec4d
The final output video:

joker.mp4

I found that the final ego video has different camera angles compared to the camera angles in my depth video.