Opening Streams Manually

[xlsupport]

I'm slowly getting acquainted with Flyleaf. Going thru the samples, experimenting with configurations,, etc. My ultimate goal is building an IPTV app for my personal use. I'm a fairly experienced developer (Office add-ins for 20+ years), but no experience (or deepdive interest) with AVS streaming.

I've noted that Audio.Streams.Count varies from 0 to a few. The zero count appears related to Embedded stuff. (tbh: No idea).
But I want to understand which of Streams is selected by default, and how to select a different one...

Can't find anything in samples. A quick tip to point me in the right direction would be highly appreciated.
Thanks, Jurgen

[SuRGeoNix]

Hi @xlsupport,

I suggest your read the following (if you didn't already):-

• https://github.com/SuRGeoNix/Flyleaf/wiki/Player-(Open)
• https://github.com/SuRGeoNix/Flyleaf/wiki/Advanced

So, the default suggest stream logic works with the plugins and the default one can be found here

I'm not sure what you want to achieve, but maybe in your case you can simply do the following:-
(NOTE: I found a null reference bug which I will fix soon, long time to use this way manually)

// Use your own async logic and do the following steps in sync mode

// Open the input but don't enable any embedded streams yet so you can decide after open that you will have all the required info
Player.Open(@"url", defaultPlaylistItem: true, defaultVideo: false, defaultAudio: false, defaultSubtitles: false);

// After checking what you want to enable, start enabling the stream but resync only at the last one for performance (or don't resync at all if you just opening, to avoid seek completely)
Player.Open(Player.Audio.Streams[0], resync: false); // Always prevent resync when you plan to enable more streams (prefer video stream when you plan to resync)
Player.Open(Player.Video.Streams[0], resync: false, defaultAudio: false); // 1.Don't let it choose the audio stream, 2. Don't seek at all as we consider is initially resynced (if we seek/resync it can even cause issues in some cases/formats)

// You manually need to start Playing
Player.Play();

The disadvantaged of this is that you don't use Flyleaf's workflow logic, so ideally you might want to write your own StreamSuggester with higher priority from the default one. Note that you might create a higher bandwidth while enabling an audio stream that it's on different program than video stream. (default suggest logic aware of that)

NOTE: Currently undocumented
If you writing your plugin within your main assembly you will need to manually load it with, e.g.:-

Engine.Plugins.LoadPlugin(Assembly.GetExecutingAssembly())

[xlsupport]

Example... pseudo but I hope you'll understand ;-)

Designer: DataContext is my main viewmodel Director
Runtime: DataContext is a FlyLeafHost
Both have (the same) Player as a property.

<UserControl x:Name="TheRoot" d:DataContext="{Binding Path=Director, Source={d:DesignInstance {x:Type vm:AppVM}, IsDesignTimeCreatable=True}}">
    <DockPanel Style="{StaticResource DockDataStyle}" d:DataContext="{Binding Player}">
        <!--  All the content  bound directly to properties of its datacontext. (There is no PlayerProperty in code behind)  -->
    </DockPanel>
</UserControl>


<!--  We use a style/trigger to Block/Allow the DataContext within the DockPanel.  -->
<Style x:Key="DockDataStyle" TargetType="DockPanel">
    <Setter Property="DataContext" Value="{x:Null}" />
    <Style.Triggers>
        <DataTrigger Binding="{Binding Visibility, ElementName=TheRoot}" Value="Visible">
            <Setter Property="DataContext" Value="{Binding Player}" />
        </DataTrigger>
    </Style.Triggers>
</Style>

Assuming you've learned a bit since and know what those d: statements do..
icymi: setting properties in Designer only, ignored @ runtime..

[SuRGeoNix]

That's PlayerDebug right? I guess I've learned something then. My understanding was that a collapsed/invisible panel will auto disable the bindings.

[xlsupport]

It is. And DataContext must exist by default => No DataContext (aka ViewModel) => all bindings are useless. no Data, no Commands, no Control. I referred to more ways to Rome earlier.. I'm starting to understand where your cumbersome Control/Player/Host/Overlay handling comes from.

[xlsupport]

@SuRGeoNix I've got a few more questions re subtitles...

a) Hard subrip end up in SubsText. Is there a default/standard way to display this?
I'm now showing it in a TextBlock in my FlyHost Content (Overlay). Where I can easily control the rendering, but like to sync the margin to the bottom of the actual playing video when video size aspect != control size aspect.

b) Need to figure out how to control the way ffmpeg renders the subtitles. Size/Color/Background.
Not a fan of the big black background, I prefer wpf's dropshadow. ;-)

c) I now can change audio/subtitle streams. But I'd like to see a property which indicates the current StreamIndex.
and If you'd make with a setter... ;-)

d) Noted that changing Subs on a (buffered) live stream may lead to lock/stutter. Subs are simple hard subrips.
And.. there's dvb_teletext! I'm filtering those out now ;-)

Or should I have asked above in a new thread?

Jurgen

[SuRGeoNix]

@xlsupport For bitmap subtitles the render will draw them, can't really customize much there (you need ocr? or changing background color?). Maybe if you really need I could look into margins with a config (open an issue for that).

Rest format ffmpeg will parse them to flyleaf as ASS format. You can use your own Parse for that if you want through Config.Subtitles.Parser

Even if the default parser fills the styles (italic/bold/colors etc..) it seems that I've removed to "screaming" also the styles during the playback. I could bring them back if you want.

In Wpf now when you receive the SubsText you can customize it as you want (as FlyleafME does for example with the shadows and config).

Open also an issue for the StreamIndex and I will try to include (so I can't forget)

For d) I'm not sure what is going on and If I could something about it.

John

[xlsupport]

Just saw your styling of the Outlined/Shadowad subtitles in FlyLeafMe.xaml...

Try following ;-)

<TextBlock  FontSize="32" Text="{Binding Player.Subtitles.SubsText}">
     <TextBlock.Effect>
         <DropShadowEffect RenderingBias="Performance" ShadowDepth="1" />
     </TextBlock.Effect>
 </TextBlock>

(Shadow colors,direction distance etc can be specified in the Effect, but the default works pretty good for me..)

Did I mention I was new to this AVS stuff?
Never realized some of those subtitles were actual bitmaps ;-)