Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

OTIO loading: question about file reader #124

Open
faulknermano opened this issue Oct 31, 2024 · 9 comments
Open

OTIO loading: question about file reader #124

faulknermano opened this issue Oct 31, 2024 · 9 comments

Comments

@faulknermano
Copy link

I have an OTIO file that seems to load ok in XS v2.0.0.dev insofar as building the timeline. However, the file's attributes (those found in the Media bin columns) are all undefined. I don't know to what extent the OTIO loader has been implemented.

(Btw, I was unusure about how the paths should be constructed. So I followed the way an .xst writes the file out, i.e. "file://localhost/disk/..../myimage.{:04d}.jpg")

If I use load media using XS's loading methods (e.g. Add media from clipboard), and then save out the .xst file, I see that my "media_ref" data dict is also filled out properly. The "reader" key reads "FFMPEG", also.

But I load the OTIO and save out the .xst file, the media_ref is filled with zero/default values, and the "reader" key is an empty string.

So, is there a way that I should I write my OTIO file for XS to read it? Or is file loading not fully implemented?

Thanks for reading.

@alatdneg
Copy link
Contributor

alatdneg commented Nov 4, 2024

Does the media play that's loaded into the timeline ? Loading otio should be supported including loading / creating of media.
Though I've not tested this outside of dneg.

@faulknermano
Copy link
Author

faulknermano commented Nov 6, 2024

Hi @alatdneg , no it doesn't actually play.
This is the otio file.

{
    "OTIO_SCHEMA": "Timeline.1",
    "metadata": {},
    "name": "SQ1100",
    "global_start_time": {
        "OTIO_SCHEMA": "RationalTime.1",
        "rate": 24.0,
        "value": 0.0
    },
    "tracks": {
        "OTIO_SCHEMA": "Stack.1",
        "metadata": {},
        "name": "TrackStack",
        "source_range": null,
        "effects": [],
        "markers": [],
        "children": [
            {
                "OTIO_SCHEMA": "Track.1",
                "metadata": {},
                "name": "SQ1100",
                "source_range": null,
                "effects": [],
                "markers": [],
                "children": [
                    {
                        "OTIO_SCHEMA": "Clip.1",
                        "metadata": {},
                        "name": "SQ1100__0660",
                        "source_range": {
                            "OTIO_SCHEMA": "TimeRange.1",
                            "duration": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 10.0
                            },
                            "start_time": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 101.0
                            }
                        },
                        "effects": [],
                        "markers": [],
                        "media_reference": {
                            "OTIO_SCHEMA": "ExternalReference.1",
                            "metadata": {},
                            "name": "",
                            "available_range": {
                                "OTIO_SCHEMA": "TimeRange.1",
                                "duration": {
                                    "OTIO_SCHEMA": "RationalTime.1",
                                    "rate": 25.0,
                                    "value": 10.0
                                },
                                "start_time": {
                                    "OTIO_SCHEMA": "RationalTime.1",
                                    "rate": 25.0,
                                    "value": 101.0
                                }
                            },
                            "target_url": "file://localhost///vdisk/SMF/1100/0660/animation/published/images/img_seq__polish_cam_0660_shake/1100__0660__polish_cam_0660_shake__v003/frames/1920x804/1100__0660__polish_cam_0660_shake__v003.{:04d}.jpg"
                        }
                    },
                    {
                        "OTIO_SCHEMA": "Clip.1",
                        "metadata": {},
                        "name": "SQ1100__0460",
                        "source_range": {
                            "OTIO_SCHEMA": "TimeRange.1",
                            "duration": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 162.0
                            },
                            "start_time": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 101.0
                            }
                        },
                        "effects": [],
                        "markers": [],
                        "media_reference": {
                            "OTIO_SCHEMA": "ExternalReference.1",
                            "metadata": {},
                            "name": "",
                            "available_range": {
                                "OTIO_SCHEMA": "TimeRange.1",
                                "duration": {
                                    "OTIO_SCHEMA": "RationalTime.1",
                                    "rate": 25.0,
                                    "value": 162.0
                                },
                                "start_time": {
                                    "OTIO_SCHEMA": "RationalTime.1",
                                    "rate": 25.0,
                                    "value": 101.0
                                }
                            },
                            "target_url": "file://localhost///vdisk/SMF/1100/0460/animation/published/images/img_seq__polish_cam_0460_shake/1100__0460__polish_cam_0460_shake__v002/frames/1920x804/1100__0460__polish_cam_0460_shake__v002.{:04d}.jpg"
                        }
                    },
                    {
                        "OTIO_SCHEMA": "Clip.1",
                        "metadata": {},
                        "name": "SQ1100__0050",
                        "source_range": {
                            "OTIO_SCHEMA": "TimeRange.1",
                            "duration": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 32.0
                            },
                            "start_time": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 101.0
                            }
                        },
                        "effects": [],
                        "markers": [],
                        "media_reference": {
                            "OTIO_SCHEMA": "ExternalReference.1",
                            "metadata": {},
                            "name": "",
                            "available_range": {
                                "OTIO_SCHEMA": "TimeRange.1",
                                "duration": {
                                    "OTIO_SCHEMA": "RationalTime.1",
                                    "rate": 25.0,
                                    "value": 32.0
                                },
                                "start_time": {
                                    "OTIO_SCHEMA": "RationalTime.1",
                                    "rate": 25.0,
                                    "value": 101.0
                                }
                            },
                            "target_url": "file://localhost///vdisk/SMF/1100/0050/animation/published/images/shot_bundle__animation_out/1100__0050__animation_out__v003/frames/1920x804/1100__0050__animation_out__v003.{:04d}.exr"
                        }
                    },
                    {
                        "OTIO_SCHEMA": "Clip.1",
                        "metadata": {},
                        "name": "SQ1100__0420",
                        "source_range": {
                            "OTIO_SCHEMA": "TimeRange.1",
                            "duration": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 57.0
                            },
                            "start_time": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 101.0
                            }
                        },
                        "effects": [],
                        "markers": [],
                        "media_reference": {
                            "OTIO_SCHEMA": "ExternalReference.1",
                            "metadata": {},
                            "name": "",
                            "available_range": {
                                "OTIO_SCHEMA": "TimeRange.1",
                                "duration": {
                                    "OTIO_SCHEMA": "RationalTime.1",
                                    "rate": 25.0,
                                    "value": 57.0
                                },
                                "start_time": {
                                    "OTIO_SCHEMA": "RationalTime.1",
                                    "rate": 25.0,
                                    "value": 101.0
                                }
                            },
                            "target_url": "file://localhost///vdisk/SMF/1100/0420/animation/published/images/img_seq__polish_cam_0420_shake/1100__0420__polish_cam_0420_shake__v001/frames/1920x804/1100__0420__polish_cam_0420_shake__v001.{:04d}.jpg"
                        }
                    },
                    {
                        "OTIO_SCHEMA": "Clip.1",
                        "metadata": {},
                        "name": "SQ1100__0120",
                        "source_range": {
                            "OTIO_SCHEMA": "TimeRange.1",
                            "duration": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 69.0
                            },
                            "start_time": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 101.0
                            }
                        },
                        "effects": [],
                        "markers": [],
                        "media_reference": {
                            "OTIO_SCHEMA": "ExternalReference.1",
                            "metadata": {},
                            "name": "",
                            "available_range": {
                                "OTIO_SCHEMA": "TimeRange.1",
                                "duration": {
                                    "OTIO_SCHEMA": "RationalTime.1",
                                    "rate": 25.0,
                                    "value": 69.0
                                },
                                "start_time": {
                                    "OTIO_SCHEMA": "RationalTime.1",
                                    "rate": 25.0,
                                    "value": 101.0
                                }
                            },
                            "target_url": "file://localhost///vdisk/SMF/1100/0120/animation/published/images/shot_bundle__animation_out/1100__0120__animation_out__v001/frames/1920x804/1100__0120__animation_out__v001.{:04d}.exr"
                        }
                    },
                    {
                        "OTIO_SCHEMA": "Clip.1",
                        "metadata": {},
                        "name": "SQ1100__0040",
                        "source_range": {
                            "OTIO_SCHEMA": "TimeRange.1",
                            "duration": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 24.0
                            },
                            "start_time": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 101.0
                            }
                        },
                        "effects": [],
                        "markers": [],
                        "media_reference": {
                            "OTIO_SCHEMA": "ExternalReference.1",
                            "metadata": {},
                            "name": "",
                            "available_range": {
                                "OTIO_SCHEMA": "TimeRange.1",
                                "duration": {
                                    "OTIO_SCHEMA": "RationalTime.1",
                                    "rate": 25.0,
                                    "value": 24.0
                                },
                                "start_time": {
                                    "OTIO_SCHEMA": "RationalTime.1",
                                    "rate": 25.0,
                                    "value": 101.0
                                }
                            },
                            "target_url": "file://localhost///vdisk/SMF/1100/0040/animation/published/images/img_seq__polish_cam_0040_shake/1100__0040__polish_cam_0040_shake__v001/frames/1920x804/1100__0040__polish_cam_0040_shake__v001.{:04d}.jpg"
                        }
                    },
                    {
                        "OTIO_SCHEMA": "Clip.1",
                        "metadata": {},
                        "name": "SQ1100__0720",
                        "source_range": {
                            "OTIO_SCHEMA": "TimeRange.1",
                            "duration": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 17.0
                            },
                            "start_time": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 101.0
                            }
                        },
                        "effects": [],
                        "markers": [],
                        "media_reference": {
                            "OTIO_SCHEMA": "ExternalReference.1",
                            "metadata": {},
                            "name": "",
                            "available_range": {
                                "OTIO_SCHEMA": "TimeRange.1",
                                "duration": {
                                    "OTIO_SCHEMA": "RationalTime.1",
                                    "rate": 25.0,
                                    "value": 17.0
                                },
                                "start_time": {
                                    "OTIO_SCHEMA": "RationalTime.1",
                                    "rate": 25.0,
                                    "value": 101.0
                                }
                            },
                            "target_url": "file://localhost///vdisk/SMF/1100/0720/animation/published/images/shot_bundle__animation_out/1100__0720__animation_out__v007/frames/1920x804/1100__0720__animation_out__v007.{:04d}.exr"
                        }
                    },
                    {
                        "OTIO_SCHEMA": "Clip.1",
                        "metadata": {},
                        "name": "SQ1100__0130",
                        "source_range": {
                            "OTIO_SCHEMA": "TimeRange.1",
                            "duration": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 39.0
                            },
                            "start_time": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 101.0
                            }
                        },
                        "effects": [],
                        "markers": [],
                        "media_reference": {
                            "OTIO_SCHEMA": "ExternalReference.1",
                            "metadata": {},
                            "name": "",
                            "available_range": {
                                "OTIO_SCHEMA": "TimeRange.1",
                                "duration": {
                                    "OTIO_SCHEMA": "RationalTime.1",
                                    "rate": 25.0,
                                    "value": 39.0
                                },
                                "start_time": {
                                    "OTIO_SCHEMA": "RationalTime.1",
                                    "rate": 25.0,
                                    "value": 101.0
                                }
                            },
                            "target_url": "file://localhost///vdisk/SMF/1100/0130/animation/published/images/img_seq__polish_cam_0130_shake/1100__0130__polish_cam_0130_shake__v001/frames/1920x804/1100__0130__polish_cam_0130_shake__v001.{:04d}.jpg"
                        }
                    },
                    {
                        "OTIO_SCHEMA": "Clip.1",
                        "metadata": {},
                        "name": "SQ1100__0760",
                        "source_range": {
                            "OTIO_SCHEMA": "TimeRange.1",
                            "duration": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 20.0
                            },
                            "start_time": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 101.0
                            }
                        },
                        "effects": [],
                        "markers": [],
                        "media_reference": {
                            "OTIO_SCHEMA": "ExternalReference.1",
                            "metadata": {},
                            "name": "",
                            "available_range": {
                                "OTIO_SCHEMA": "TimeRange.1",
                                "duration": {
                                    "OTIO_SCHEMA": "RationalTime.1",
                                    "rate": 25.0,
                                    "value": 20.0
                                },
                                "start_time": {
                                    "OTIO_SCHEMA": "RationalTime.1",
                                    "rate": 25.0,
                                    "value": 101.0
                                }
                            },
                            "target_url": "file://localhost///vdisk/SMF/1100/0760/animation/published/images/img_seq__polish_cam_0760_shake/1100__0760__polish_cam_0760_shake__v004/frames/1920x804/1100__0760__polish_cam_0760_shake__v004.{:04d}.jpg"
                        }
                    },
                    {
                        "OTIO_SCHEMA": "Clip.1",
                        "metadata": {},
                        "name": "SQ1100__0740",
                        "source_range": {
                            "OTIO_SCHEMA": "TimeRange.1",
                            "duration": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 10.0
                            },
                            "start_time": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 101.0
                            }
                        },
                        "effects": [],
                        "markers": [],
                        "media_reference": {
                            "OTIO_SCHEMA": "ExternalReference.1",
                            "metadata": {},
                            "name": "",
                            "available_range": {
                                "OTIO_SCHEMA": "TimeRange.1",
                                "duration": {
                                    "OTIO_SCHEMA": "RationalTime.1",
                                    "rate": 25.0,
                                    "value": 10.0
                                },
                                "start_time": {
                                    "OTIO_SCHEMA": "RationalTime.1",
                                    "rate": 25.0,
                                    "value": 101.0
                                }
                            },
                            "target_url": "file://localhost///vdisk/SMF/1100/0740/animation/published/images/shot_bundle__animation_out/1100__0740__animation_out__v006/frames/1920x804/1100__0740__animation_out__v006.{:04d}.exr"
                        }
                    },
                    {
                        "OTIO_SCHEMA": "Clip.1",
                        "metadata": {},
                        "name": "SQ1100__0220",
                        "source_range": {
                            "OTIO_SCHEMA": "TimeRange.1",
                            "duration": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 136.0
                            },
                            "start_time": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 101.0
                            }
                        },
                        "effects": [],
                        "markers": [],
                        "media_reference": {
                            "OTIO_SCHEMA": "ExternalReference.1",
                            "metadata": {},
                            "name": "",
                            "available_range": {
                                "OTIO_SCHEMA": "TimeRange.1",
                                "duration": {
                                    "OTIO_SCHEMA": "RationalTime.1",
                                    "rate": 25.0,
                                    "value": 136.0
                                },
                                "start_time": {
                                    "OTIO_SCHEMA": "RationalTime.1",
                                    "rate": 25.0,
                                    "value": 101.0
                                }
                            },
                            "target_url": "file://localhost///vdisk/SMF/1100/0220/animation/published/images/shot_bundle__animation_out/1100__0220__animation_out__v004/frames/1920x804/1100__0220__animation_out__v004.{:04d}.exr"
                        }
                    },
                    {
                        "OTIO_SCHEMA": "Clip.1",
                        "metadata": {},
                        "name": "SQ1100__0440",
                        "source_range": {
                            "OTIO_SCHEMA": "TimeRange.1",
                            "duration": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 28.0
                            },
                            "start_time": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 101.0
                            }
                        },
                        "effects": [],
                        "markers": [],
                        "media_reference": {
                            "OTIO_SCHEMA": "ExternalReference.1",
                            "metadata": {},
                            "name": "",
                            "available_range": {
                                "OTIO_SCHEMA": "TimeRange.1",
                                "duration": {
                                    "OTIO_SCHEMA": "RationalTime.1",
                                    "rate": 25.0,
                                    "value": 28.0
                                },
                                "start_time": {
                                    "OTIO_SCHEMA": "RationalTime.1",
                                    "rate": 25.0,
                                    "value": 101.0
                                }
                            },
                            "target_url": "file://localhost///vdisk/SMF/1100/0440/animation/published/images/shot_bundle__animation_out/1100__0440__animation_out__v008/frames/1920x804/1100__0440__animation_out__v008.{:04d}.exr"
                        }
                    },
                    {
                        "OTIO_SCHEMA": "Clip.1",
                        "metadata": {},
                        "name": "SQ1100__0480",
                        "source_range": {
                            "OTIO_SCHEMA": "TimeRange.1",
                            "duration": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 65.0
                            },
                            "start_time": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 101.0
                            }
                        },
                        "effects": [],
                        "markers": [],
                        "media_reference": {
                            "OTIO_SCHEMA": "ExternalReference.1",
                            "metadata": {},
                            "name": "",
                            "available_range": {
                                "OTIO_SCHEMA": "TimeRange.1",
                                "duration": {
                                    "OTIO_SCHEMA": "RationalTime.1",
                                    "rate": 25.0,
                                    "value": 65.0
                                },
                                "start_time": {
                                    "OTIO_SCHEMA": "RationalTime.1",
                                    "rate": 25.0,
                                    "value": 101.0
                                }
                            },
                            "target_url": "file://localhost///vdisk/SMF/1100/0480/animation/published/images/shot_bundle__animation_out/1100__0480__animation_out__v010/frames/1920x804/1100__0480__animation_out__v010.{:04d}.exr"
                        }
                    },
                    {
                        "OTIO_SCHEMA": "Clip.1",
                        "metadata": {},
                        "name": "SQ1100__0110",
                        "source_range": {
                            "OTIO_SCHEMA": "TimeRange.1",
                            "duration": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 34.0
                            },
                            "start_time": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 101.0
                            }
                        },
                        "effects": [],
                        "markers": [],
                        "media_reference": {
                            "OTIO_SCHEMA": "ExternalReference.1",
                            "metadata": {},
                            "name": "",
                            "available_range": {
                                "OTIO_SCHEMA": "TimeRange.1",
                                "duration": {
                                    "OTIO_SCHEMA": "RationalTime.1",
                                    "rate": 25.0,
                                    "value": 34.0
                                },
                                "start_time": {
                                    "OTIO_SCHEMA": "RationalTime.1",
                                    "rate": 25.0,
                                    "value": 101.0
                                }
                            },
                            "target_url": "file://localhost///vdisk/SMF/1100/0110/animation/published/images/img_seq__polish_cam_0110_shake/1100__0110__polish_cam_0110_shake__v002/frames/1920x804/1100__0110__polish_cam_0110_shake__v002.{:04d}.jpg"
                        }
                    },
                    {
                        "OTIO_SCHEMA": "Clip.1",
                        "metadata": {},
                        "name": "SQ1100__0620",
                        "source_range": {
                            "OTIO_SCHEMA": "TimeRange.1",
                            "duration": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 51.0
                            },
                            "start_time": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 101.0
                            }
                        },
                        "effects": [],
                        "markers": [],
                        "media_reference": {
                            "OTIO_SCHEMA": "ExternalReference.1",
                            "metadata": {},
                            "name": "",
                            "available_range": {
                                "OTIO_SCHEMA": "TimeRange.1",
                                "duration": {
                                    "OTIO_SCHEMA": "RationalTime.1",
                                    "rate": 25.0,
                                    "value": 51.0
                                },
                                "start_time": {
                                    "OTIO_SCHEMA": "RationalTime.1",
                                    "rate": 25.0,
                                    "value": 101.0
                                }
                            },
                            "target_url": "file://localhost///vdisk/SMF/1100/0620/animation/published/images/img_seq__polish_cam_0620_shake/1100__0620__polish_cam_0620_shake__v001/frames/1920x804/1100__0620__polish_cam_0620_shake__v001.{:04d}.jpg"
                        }
                    },
                    {
                        "OTIO_SCHEMA": "Clip.1",
                        "metadata": {},
                        "name": "SQ1100__0190",
                        "source_range": {
                            "OTIO_SCHEMA": "TimeRange.1",
                            "duration": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 46.0
                            },
                            "start_time": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 101.0
                            }
                        },
                        "effects": [],
                        "markers": [],
                        "media_reference": {
                            "OTIO_SCHEMA": "ExternalReference.1",
                            "metadata": {},
                            "name": "",
                            "available_range": {
                                "OTIO_SCHEMA": "TimeRange.1",
                                "duration": {
                                    "OTIO_SCHEMA": "RationalTime.1",
                                    "rate": 25.0,
                                    "value": 46.0
                                },
                                "start_time": {
                                    "OTIO_SCHEMA": "RationalTime.1",
                                    "rate": 25.0,
                                    "value": 101.0
                                }
                            },
                            "target_url": "file://localhost///vdisk/SMF/1100/0190/animation/published/images/img_seq__polish_cam_0190_shake/1100__0190__polish_cam_0190_shake__v002/frames/1920x804/1100__0190__polish_cam_0190_shake__v002.{:04d}.jpg"
                        }
                    },
                    {
                        "OTIO_SCHEMA": "Clip.1",
                        "metadata": {},
                        "name": "SQ1100__0640",
                        "source_range": {
                            "OTIO_SCHEMA": "TimeRange.1",
                            "duration": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 14.0
                            },
                            "start_time": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 101.0
                            }
                        },
                        "effects": [],
                        "markers": [],
                        "media_reference": {
                            "OTIO_SCHEMA": "ExternalReference.1",
                            "metadata": {},
                            "name": "",
                            "available_range": {
                                "OTIO_SCHEMA": "TimeRange.1",
                                "duration": {
                                    "OTIO_SCHEMA": "RationalTime.1",
                                    "rate": 25.0,
                                    "value": 14.0
                                },
                                "start_time": {
                                    "OTIO_SCHEMA": "RationalTime.1",
                                    "rate": 25.0,
                                    "value": 101.0
                                }
                            },
                            "target_url": "file://localhost///vdisk/SMF/1100/0640/animation/published/images/img_seq__polish_cam_0640_shake/1100__0640__polish_cam_0640_shake__v003/frames/1920x804/1100__0640__polish_cam_0640_shake__v003.{:04d}.jpg"
                        }
                    },
                    {
                        "OTIO_SCHEMA": "Clip.1",
                        "metadata": {},
                        "name": "SQ1100__0240",
                        "source_range": {
                            "OTIO_SCHEMA": "TimeRange.1",
                            "duration": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 63.0
                            },
                            "start_time": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 101.0
                            }
                        },
                        "effects": [],
                        "markers": [],
                        "media_reference": {
                            "OTIO_SCHEMA": "ExternalReference.1",
                            "metadata": {},
                            "name": "",
                            "available_range": {
                                "OTIO_SCHEMA": "TimeRange.1",
                                "duration": {
                                    "OTIO_SCHEMA": "RationalTime.1",
                                    "rate": 25.0,
                                    "value": 63.0
                                },
                                "start_time": {
                                    "OTIO_SCHEMA": "RationalTime.1",
                                    "rate": 25.0,
                                    "value": 101.0
                                }
                            },
                            "target_url": "file://localhost///vdisk/SMF/1100/0240/animation/published/images/img_seq__polish_cam_0240_shake/1100__0240__polish_cam_0240_shake__v005/frames/1920x804/1100__0240__polish_cam_0240_shake__v005.{:04d}.jpg"
                        }
                    }
                ],
                "kind": "Video"
            }
        ]
    }
}

The result is that in Media "bin" I get "undefined" in some of the columns like Resolution, Created, Artist. There is no thumbnail, and nothing can be played.

Btw, the timeline loads fine; I can see the shots lined up properly.

I'm going to double check my OTIO libs to make sure they're in line with XS's.

@alatdneg
Copy link
Contributor

alatdneg commented Nov 6, 2024 via email

@faulknermano
Copy link
Author

faulknermano commented Nov 11, 2024

@alatdneg , thanks for that. I'm going to try out QTs first, and investigate image sequences afterwards.

@faulknermano
Copy link
Author

Hi @alatdneg , I've been able to successfully load QTs via OTIO, but XS 2.0.0dev crashes when I try to view the timeline. This is the OTIO file I'm working with:

{
    "OTIO_SCHEMA": "Timeline.1",
    "metadata": {},
    "name": "timeline",
    "global_start_time": null,
    "tracks": {
        "OTIO_SCHEMA": "Stack.1",
        "metadata": {},
        "name": "tracks",
        "source_range": null,
        "effects": [],
        "markers": [],
        "enabled": true,
        "children": [
            {
                "OTIO_SCHEMA": "Track.1",
                "metadata": {},
                "name": "Track1",
                "source_range": null,
                "effects": [],
                "markers": [],
                "enabled": true,
                "children": [
                    {
                        "OTIO_SCHEMA": "Clip.2",
                        "metadata": {},
                        "name": "clip1",
                        "source_range": {
                            "OTIO_SCHEMA": "TimeRange.1",
                            "duration": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 100.0
                            },
                            "start_time": {
                                "OTIO_SCHEMA": "RationalTime.1",
                                "rate": 24.0,
                                "value": 1016.0
                            }
                        },
                        "effects": [],
                        "markers": [],
                        "enabled": true,
                        "media_references": {
                            "DEFAULT_MEDIA": {
                                "OTIO_SCHEMA": "ExternalReference.1",
                                "metadata": {},
                                "name": "",
                                "available_range": {
                                    "OTIO_SCHEMA": "TimeRange.1",
                                    "duration": {
                                        "OTIO_SCHEMA": "RationalTime.1",
                                        "rate": 23.98,
                                        "value": 100.0
                                    },
                                    "start_time": {
                                        "OTIO_SCHEMA": "RationalTime.1",
                                        "rate": 23.98,
                                        "value": 1016.0
                                    }
                                },
                                "available_image_bounds": null,
                                "target_url": "file:///vdisk/G20/quicktimes/HEL/0150/layout/published/quicktimes/render__br_beauty/HEL__0150__br_beauty__v034/primary/HEL__0150__br_beauty__layout__v034-qt1_1080p_h264.mp4"
                            }
                        },
                        "active_media_reference_key": "DEFAULT_MEDIA"
                    }
                ],
                "kind": "Video"
            }
        ]
    }
}

Note that the file in question has this ffrpobe result:

Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '//vdisk/G20/quicktimes/HEL/0150/layout/published/quicktimes/render__br_beauty/HEL__0150__br_beauty__v034/primary/HEL__0150__br_beauty__layout__v034-qt1_1080p_h264.mp4':
  Metadata:
    major_brand     : isom
    minor_version   : 512
    compatible_brands: isomiso2avc1mp41
    encoder         : Lavf60.3.100
  Duration: 00:00:04.92, start: 0.000000, bitrate: 1525 kb/s
  Stream #0:0[0x1](und): Video: h264 (High) (avc1 / 0x31637661), yuv420p(tv, bt709, progressive), 1920x1080 [SAR 1:1 DAR 16:9], 1389 kb/s, 23.98 fps, 23.98 tbr, 24k tbn (default)
    Metadata:
      handler_name    : VideoHandler
      vendor_id       : [0][0][0][0]
      encoder         : Lavc60.3.100 libx264
      timecode        : 00:00:42:08
  Stream #0:1[0x2](und): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 127 kb/s (default)
    Metadata:
      handler_name    : SoundHandler
      vendor_id       : [0][0][0][0]
  Stream #0:2[0x3](eng): Data: none (tmcd / 0x64636D74), 0 kb/s
    Metadata:
      handler_name    : VideoHandler
      timecode        : 00:00:42:08

The timecode is at 00:00:42:08 which is frame 1016.

When I load this into XS, QT loads. I see the otio file under the Media panel, and I can actually play this QT back in the viewport.

But when I double-click on the otio entry in the Media panel to see the timeline, XS crashes.

If I remove the url from the otio file, and repeat the process, XS doesn't crash; it shows my the timeline with the shot tag starting at 1016.

I've simplified otio file generation to follow the example in https://github.com/AcademySoftwareFoundation/OpenTimelineIO/blob/main/examples/build_simple_timeline.py.

Is there something you can see in the otio file that's wrong? Or any theory why it crashes?

@alatdneg
Copy link
Contributor

alatdneg commented Nov 27, 2024 via email

@faulknermano
Copy link
Author

@alatdneg pardon me, yes, there was; I should've posted the first time:

Error: signal 11:
xstudio.bin[0x676e94]
/lib64/libc.so.6(+0x3e6f0)[0x7fb2eda3e6f0]
xstudio.bin(_ZNK3caf13intrusive_ptrINS_3uri9impl_typeEE3getEv+0xc)[0x6ee8b2]
xstudio.bin(_ZN3caf13intrusive_ptrINS_3uri9impl_typeEEC1ERKS3_+0x1c)[0x6c5676]
xstudio.bin(_ZN3caf3uriC1ERKS0_+0x23)[0x6a063f]
xstudio.bin(_ZN7xstudio5media9AVFrameIDC2ERKS1_+0x3e)[0x6a29e0]
/packages/vendor/github.com/xstudio/linux_64/2.0.0.dev/bin/../share/xstudio/lib/libtimeline.so(_ZN9__gnu_cxx13new_allocatorIN7xstudio5media9AVFrameIDEE9constructIS3_JRKS3_EEEvPT_DpOT0_+0x47)[0x7fb2f3600d4f]
/packages/vendor/github.com/xstudio/linux_64/2.0.0.dev/bin/../share/xstudio/lib/libtimeline.so(_ZNSt16allocator_traitsISaIN7xstudio5media9AVFrameIDEEE9constructIS2_JRKS2_EEEvRS3_PT_DpOT0_+0x36)[0x7fb2f35fea68]
/packages/vendor/github.com/xstudio/linux_64/2.0.0.dev/bin/../share/xstudio/lib/libtimeline.so(_ZNSt23_Sp_counted_ptr_inplaceIN7xstudio5media9AVFrameIDESaIS2_ELN9__gnu_cxx12_Lock_policyE2EEC2IJRKS2_EEES3_DpOT_+0x99)[0x7fb2f35fb715]
/packages/vendor/github.com/xstudio/linux_64/2.0.0.dev/bin/../share/xstudio/lib/libtimeline.so(_ZNSt14__shared_countILN9__gnu_cxx12_Lock_policyE2EEC2IN7xstudio5media9AVFrameIDESaIS6_EJRKS6_EEERPT_St20_Sp_alloc_shared_tagIT0_EDpOT1_+0x9d)[0x7fb2f35f50ad]
QObject::~QObject: Timers cannot be stopped from another thread
QObject::~QObject: Timers cannot be stopped from another thread
Error: signal 11:
xstudio.bin[0x676e94]
/lib64/libc.so.6(+0x3e6f0)[0x7fb2eda3e6f0]
/lib64/libstdc++.so.6(_ZNSsC2ERKSs+0x1d)[0x7fb2edef64fd]
xstudio.bin(_ZNSt4pairIKiSsEC1ERKS1_+0x37)[0x8c78f3]
/packages/vendor/github.com/xstudio/linux_64/2.0.0.dev/bin/../share/xstudio/lib/libmodule.so(_ZN7xstudio6module9Attribute10role_indexERKSs+0x74)[0x7fb2ef0f46c4]
/packages/vendor/github.com/xstudio/linux_64/2.0.0.dev/bin/../share/xstudio/lib/libmodule.so(+0x2a97b0)[0x7fb2ef1927b0]
/packages/vendor/github.com/xstudio/linux_64/2.0.0.dev/bin/../share/xstudio/lib/libmodule.so(+0x2c4d47)[0x7fb2ef1add47]
/packages/vendor/github.com/xstudio/linux_64/2.0.0.dev/bin/../share/xstudio/lib/libmodule.so(+0x2c4dc6)[0x7fb2ef1addc6]
/packages/vendor/github.com/xstudio/linux_64/2.0.0.dev/bin/../share/xstudio/lib/libmodule.so(+0x2c4e40)[0x7fb2ef1ade40]
/packages/vendor/github.com/xstudio/linux_64/2.0.0.dev/bin/../share/xstudio/lib/libmodule.so(+0x2c5fae)[0x7fb2ef1aefae]

@tedwaine
Copy link
Contributor

Hi @faulknermano,

If you have the time, could you pull from my fork (develop branch), build and try again. I have just updated my fork to sync with our internal develop branch. Recently I've done some refactoring that might have fixed the bug that you have hit here, but I'm not sure.
Using our latest build I have duplicated your OTIO file above, and switched out the media path for a QT that I have on disk and it's all working as expected.

https://github.com/tedwaine/xstudio/tree/develop

@tedwaine
Copy link
Contributor

Just a further note - the latest version requires OTIO v0.17 - I can't remember if that was already the case or whether you might need to update that dependecy when you build.

When we configuring OTIO v0.17, I use -DOTIO_PYTHON_INSTALL=ON -DOTIO_INSTALL_PYTHON_MODULES=ON -DOTIO_SHARED_LIBS=OFF
The reason is that if you build OTIO with shared libs, it installs them to the python install location but not to regular /lib/ path so xstudio can't link to it at runtime unless you do some awkward fiddling with LD_LIBRARY_PATH. Building static libs, however, avoids this problem.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants