L-SMASH Source

[sneaker_ger]

Seems your question is related to http://forum.doom9.org/showthread.php?t=173525

Pure decoders can't manage these kinds of streams.
lwlibavaudiosource() seems to play it at least. I think it uses the layout of the first sample unless set otherwise.
I do hear artifacts but I don't know if they are a result of the problems with the stream you mentioned.

[tebasuna51]

lwlibavaudiosource() seems to play it at least. I think it uses the layout of the first sample unless set otherwise.
I do hear artifacts but I don't know if they are a result of the problems with the stream you mentioned.

You are rigth.
Using lwlibavaudiosource() to decode the mentioned samples I obtain a full 5.1 output with FC and LFE muted in 2.0 parts (SL and SR seems the same than FL and FR).

But I don't know if mantain the video sync, bilditup1 can do the test.

[Selur]

Got an avi which crashes LWLibavSource (64bit).
-> FORGET it, updated to r901 and now it works

[poisondeathray]

Does anybody know what the deal is with "h264_qsv" as a decoder for l-smash ? Does it need to be compiled in a special way ?

In the readme

+ decoder (defalut : "")
Names of preferred decoder candidates separated by comma.
For instance, if you prefer to use the 'h264_qsv' and 'mpeg2_qsv' decoders instead of the generally
used 'h264' and 'mpeg2video' decoder, then specify as "h264_qsv,mpeg2_qsv". The evaluations are done
in the written order and the first matched decoder is used if any.

[qyot27]

http://www.intel.com/content/www/us/en/cloud-computing/quicksync-video-ffmpeg-install-valid.html

[poisondeathray]

http://www.intel.com/content/www/us/en/cloud-computing/quicksync-video-ffmpeg-install-valid.html

Thanks, I use the ones linked on the first page as an avisynth plugin from the_weirdo's Dropbox. I'm assuming it wasn't enabled in those , because the CPU usage and speed is the same. I don't know how to compile it for avisynth.

I have qsv enabled in ffmpeg, using an autobuild script, but not for avisynth l-smash

[Selur]

using latest r911 with
clip = core.lsmas.LibavSMASHSource(source="/home/selur/Desktop/test.mp4") -> I get a Segmantation Fault with vsedit
using:
clip = core.lsmas.LWLibavSource(source="/home/selur/Desktop/test.mp4", cache=0) everything is fine
uploaded the test.mp4 file to my GoogleDrive (https://drive.google.com/drive/folders/0B_WxUS1XGCPASUZibG5XZkRfeTg?usp=sharing)
about the file:
General
Complete name : w:\test.mp4
Format : MPEG-4
Format profile : JVT
Codec ID : avc1 (isom/avc1)
File size : 3.83 MiB
Duration : 1 min
Overall bit rate : 535 kb/s
Encoded date : UTC 2016-08-21 11:33:56
Tagged date : UTC 2016-08-21 11:33:56
Writing application : Hybrid 2016.08.21.1

Video
ID : 1
Format : AVC
Format/Info : Advanced Video Codec
Format profile : High 4:4:4 Predictive@L4.1
Format settings, CABAC : Yes
Format settings, ReFrames : 4 frames
Codec ID : avc1
Codec ID/Info : Advanced Video Coding
Duration : 1 min
Bit rate : 532 kb/s
Maximum bit rate : 1 381 kb/s
Width : 720 pixels
Height : 396 pixels
Original height : 406 pixels
Display aspect ratio : 16:9
Original display aspect ratio : 16:9
Frame rate mode : Constant
Frame rate : 23.976 (24000/1001) FPS
Color space : YUV
Chroma subsampling : 4:4:4
Bit depth : 10 bits
Scan type : Progressive
Bits/(Pixel*Frame) : 0.078
Stream size : 3.81 MiB (100%)
Writing library : x264 core 148 r2694 3b70645
Encoding settings : cabac=1 / ref=3 / deblock=1:0:0 / analyse=0x3:0x111 / me=hex / subme=5 / psy=1 / psy_rd=1.00:0.00 / mixed_ref=1 / me_range=16 / chroma_me=1 / trellis=0 / 8x8dct=1 / cqm=0 / deadzone=21,11 / fast_pskip=0 / chroma_qp_offset=6 / threads=6 / lookahead_threads=1 / sliced_threads=0 / nr=0 / decimate=1 / interlaced=0 / bluray_compat=0 / constrained_intra=0 / bframes=3 / b_pyramid=2 / b_adapt=1 / b_bias=0 / direct=3 / weightb=1 / open_gop=0 / weightp=1 / keyint=250 / keyint_min=23 / scenecut=40 / intra_refresh=0 / rc_lookahead=40 / rc=crf / mbtree=0 / crf=18.0 / qcomp=0.50 / qpmin=0 / qpmax=81 / qpstep=4 / vbv_maxrate=150000 / vbv_bufsize=187500 / crf_max=0.0 / nal_hrd=none / filler=0 / ip_ratio=1.40 / pb_ratio=1.30 / aq=0
Encoded date : UTC 2016-08-21 11:33:56
Tagged date : UTC 2016-08-21 11:33:56
Color range : Limited
Matrix coefficients : BT.709

-> Is this a bug in LibavSMASHSource or in vsedit?

-----
Also the file is opened as 720x396 is there a way to open it with the original 720x406 without having to remux it beforehand?

[jriker1]

I have been encoding video with AVISynth and NeatVideo for many years. Recently I switched to using LWLibavVideoSource for MKV sources and noticed that about half the time when the video is done encoding, it's the expected size, however the file will be like a minute or two long. Anyone else have this problem with LWLibavVideoSource?

Thanks.

JR

[Groucho2004]

I have been encoding video with AVISynth and NeatVideo for many years. Recently I switched to using LWLibavVideoSource for MKV sources and noticed that about half the time when the video is done encoding, it's the expected size, however the file will be like a minute or two long. Anyone else have this problem with LWLibavVideoSource?

Thanks.

JR
Without seeing your script and info about your encoding workflow it's basically impossible to give advice.

[jriker1]

Without seeing your script and info about your encoding workflow it's basically impossible to give advice.

So simple didn't bother.

Create AVS File with only:
LWLibavVideoSource("t2a1080-debt.mkv") <-- example
Open in VDub64
Disable audio encoding
Set codec to Lagarith
Load NeatVideo plugin and set it up
Save as AVI

Didn't bother before because assuming there will be nothing here that is telling. But never know.

Thanks.

JR

[Groucho2004]

Does the script look OK if you preview it in VDub? What does VDub report in the File Info dialog?

[jriker1]

I'm trying to reencode right now so can't check, but can say yes it does. I go thru the entire file looking for areas to use for neatvideo cleanup so know the video is there. Way more than a minute anyway.

[jriker1]

OK, done encoding. Looks like it worked this time but as mentioned it sometimes seems to encode fine othertimes also completes but is a very short duration movie. So an 88GB 1 1/2 minute movie. Here is what VDub says when I open the AVS file:

Frame Size: 1920x1080, 23976fps (41708 us)
Length: 167517 frames (1:56:26.85)
Decompressor: Internal DIB decoder (YV12)
Number of keyframes: 167517
frame size: 3110400/3110400/3110400 (508832888k)
delta size: (no delta frames)
data rate: 596600 kbps (0.00% overhead)

Thanks.

jR

[jriker1]

OK I think I see what's happening just not sure why. It happened again. Video is showing as 2157.842fps. This is in the file info in VDub. If I open the source file in MediaInfo it shows 23.976 so source fps is fine. Thoughts?

Note, i will leave my VDub open and wait for a response in case I need to look at something. If I close and open it again in VDub chances are it will work the second time as usually does. Also looks like someone had a fps issue before but got lost in some trolling.

http://forum.doom9.org/showthread.php?p=1710893#post1710893

Thanks.

JR

[fvisagie]

Video is showing as 2157.842fps. This is in the file info in VDub. If I open the source file in MediaInfo it shows 23.976 so source fps is fine.

Well, there's a multiplier of 90 that presumably gets introduced in LWLibavVideoSource(). You could try remuxing the videos in tools like ffmpeg (potentially also to different containers) to see if LWLibavVideoSource() picks up the framerate more reliably then.

Until such time as you find an automatic fix, for now you could consider manually fixing the framerate with something like Assume[Scaled]FPS().

In your testing, remember to use Info() to compare results between MediaInfo, LWLibavVideoSource() and VDub.

HTH.

[LigH]

I wonder if you have a "variable framerate" source. This may have been achieved by assuming a very high base framerate and repeating individual frames different times. AviSynth only supports constant framerates.

Furthermore, I do remember mistakes in some cases of transport streams, depending on attributes of the contained video stream. More details about your original source may be useful.

[jriker1]

If I do reload this in VDub again it comes up 23.976 however here's more information on the file:

General
Count : 291
Count of stream of this kind : 1
Kind of stream : General
Kind of stream : General
Stream identifier : 0
Inform : Matroska: 18.4 GiB, 1h 38mn
Unique ID : 239127260858190402181820675171044581556
Unique ID : 239127260858190402181820675171044581556 (0xB3E63C376AF5933DB088DDC34D0C60B4)
Count of video streams : 1
Video_Format_List : AVC
Video_Format_WithHint_List : AVC
Codecs Video : AVC
Video_Language_List : English
Complete name : D:\Conversion\1 - Pre\Mike.mkv
Folder name : D:\Conversion\1 - Pre\Mike
File name : Mike
File extension : mkv
Format : Matroska
Format : Matroska
Format/Url : http://packs.matroska.org/
Format/Extensions usually used : mkv mk3d mka mks
Commercial name : Matroska
Format version : Version 4 / Version 2
Codec : Matroska
Codec : Matroska
Codec/Url : http://packs.matroska.org/
Codec/Extensions usually used : mkv mk3d mka mks
File size : 19792777397
File size : 18.4 GiB
File size : 18 GiB
File size : 18 GiB
File size : 18.4 GiB
File size : 18.43 GiB
Duration : 5912615
Duration : 1h 38mn
Duration : 1h 38mn 32s 615ms
Duration : 1h 38mn
Duration : 01:38:32.615
Overall bit rate mode : VBR
Overall bit rate mode : Variable
Overall bit rate : 26780404
Overall bit rate : 26.8 Mbps
Stream size : 393856830
Stream size : 376 MiB (2%)
Stream size : 376 MiB
Stream size : 376 MiB
Stream size : 376 MiB
Stream size : 375.6 MiB
Stream size : 376 MiB (2%)
Proportion of this stream : 0.01990
Title : Mike
Movie name : Mike
Encoded date : UTC 2016-11-02 15:28:27
File creation date : UTC 2016-11-02 15:28:27.794
File creation date (local) : 2016-11-02 10:28:27.794
File last modification date : UTC 2016-11-02 15:33:37.680
File last modification date (local) : 2016-11-02 10:33:37.680
Writing application : mkvmerge v6.6.0 ('The Edge Of The In Between') built on Dec 1 2013 17:55:00
Writing library : libebml v1.3.0 + libmatroska v1.4.1
Writing library : libebml v1.3.0 + libmatroska v1.4.1
Attachements : cover_land.jpg / small_cover.jpg / small_cover_land.jpg / cover.jpg

Video
Count : 277
Count of stream of this kind : 1
Kind of stream : Video
Kind of stream : Video
Stream identifier : 0
StreamOrder : 0
Inform : English, 26.2 Mbps, 1920*1080 (16:9), at 23.976 fps, AVC (High@L4.1) (CABAC / 2 Ref Frames)
ID : 1
ID : 1
Unique ID : 1
Format : AVC
Format/Info : Advanced Video Codec
Format/Url : http://developers.videolan.org/x264.html
Commercial name : AVC
Format profile : High@L4.1
Format settings : CABAC / 2 Ref Frames
Format settings, CABAC : Yes
Format settings, CABAC : Yes
Format settings, ReFrames : 2
Format settings, ReFrames : 2 frames
Internet media type : video/H264
Codec ID : V_MPEG4/ISO/AVC
Codec ID/Url : http://ffdshow-tryout.sourceforge.net/
Codec : V_MPEG4/ISO/AVC
Codec : AVC
Codec/Family : AVC
Codec/Info : Advanced Video Codec
Codec/Url : http://ffdshow-tryout.sourceforge.net/
Codec profile : High@L4.1
Codec settings : CABAC / 2 Ref Frames
Codec settings, CABAC : Yes
Codec_Settings_RefFrames : 2
Duration : 5912621
Duration : 1h 38mn
Duration : 1h 38mn 32s 621ms
Duration : 1h 38mn
Duration : 01:38:32.621
Bit rate mode : VBR
Bit rate mode : Variable
Bit rate : 26247474
Bit rate : 26.2 Mbps
Width : 1920
Width : 1 920 pixels
Height : 1080
Height : 1 080 pixels
Pixel aspect ratio : 1.000
Display aspect ratio : 1.778
Display aspect ratio : 16:9
Frame rate mode : CFR
Frame rate mode : Constant
Frame rate : 23.976
Frame rate : 23.976 fps
Frame count : 141761
Resolution : 8
Resolution : 8 bits
Colorimetry : 4:2:0
Color space : YUV
Chroma subsampling : 4:2:0
Bit depth : 8
Bit depth : 8 bits
Scan type : Progressive
Scan type : Progressive
Interlacement : PPF
Interlacement : Progressive
Bits/(Pixel*Frame) : 0.528
Delay : 0
Delay : 00:00:00.000
Delay, origin : Container
Delay, origin : Container
Stream size : 19398920567
Stream size : 18.1 GiB (98%)
Stream size : 18 GiB
Stream size : 18 GiB
Stream size : 18.1 GiB
Stream size : 18.07 GiB
Stream size : 18.1 GiB (98%)
Proportion of this stream : 0.98010
Title : Mike
Language : en
Language : English
Language : English
Language : en
Language : eng
Language : en
Default : No
Default : No
Forced : No
Forced : No
Buffer size : 30000000 / 30000000



Based on this is a constant frame rate.

[AzraelNewtype]

this is what fpsnum and fpsden are for. Set them. Love them.

[jriker1]

this is what fpsnum and fpsden are for. Set them. Love them.

Does that mean fpsnum should be set to 23.976 and fpsden should be set to 1? Or you supposed to set fpsnum to 24000 (though I have seen some reference 24001 in general with 23.976) and fpsden to 1001? Wasn't getting it from the doc.

Thanks.

JR

[LigH]

Assume both to be integer, then you will have 24000 : 1001.

[sneaker_ger]

Do a preview of your source, though. L-Smash's fpsnum/fpsden-conversion can get stuttery. Often AssumeFPS() is enough to do the trick because the source isn't really vfr.

[fvisagie]

If I do reload this in VDub again it comes up 23.976

...

Based on this is a constant frame rate.

Is this is an Avisynth script you loaded into VDub, or did you open the video in it directly? If the former, I suspect that Avisynth/L-SMASH would always report the video framerate as constant.

But first see if any of the suggestions help:).

[jriker1]

The above is from Mediainfo so not related to avisynth or vdub for the specs of the video.

I'm questioning if this tool is reliable for my conversions. I switched from several other plugins to avisynth because of various white screens at fast moving transition scenes but if this can't even get a basic frame rate right not good. Never saw another tool do this. Annoyed right now as I just converted another video that I was going to watch tonight and it happened again even though in VDub it said it was 23.976 before conversion. I'm going to try the settings suggested but forcing a setting doesn't sound good considering how reliable all the other tools are around this basic check.

JR

[Thunderbolt8]

is there some standalone exe command I can use to index files with lsmash (like with ffms2.exe)? reason is I would like to have some status progress bar which I dont have when using it inside megui (aside from the increasing filesize display)

[LigH]

I don't know of any. That's also the reason why MeGUI schedules an indexing job first.

[StainlessS]

You could ask the L-Smash guys to output progress every eg 5.0% to DebugView via OutputDebugString().

[Thunderbolt8]

is it normal that LSMASH does the indexing each time the script is called even though when the index file already exists? no updates etc. have been made since that file has been created, but indexing starts anew each time. its rather annoying, when I create an index file with ffms2 and then call that video again, the indexed file is usually regarded as fine and used in contrast to those created with LSMASH.

[LigH]

Indexing should only happen if there is no existing index file already (I believe it does not even check if the file date of the source is newer than the file date of the index).

Is there any possible reason that L-SMASH Source may not be able to identify the index file matching the name of the source file (e.g. non-latin characters, access rights, file attributes)?

[Taurus]

is it normal that LSMASH does the indexing each time the script is called
No, it's not nomal.
LSMASH is indexing a file at first start.
Later on the index file is used for any conversions.
There must be something wrong at your side.
Maybe LigH's suggestions shed some light?

[StainlessS]

This script (originally posted here):- http://forum.doom9.org/showthread.php?p=1707765#post1707765

Can tell how many times MeGUI is opening a script (but not if indexing at every opening, so may not be of use).

(req RT_Stats)

###
# MeGUI_ReOpenCount.avs
# http://forum.doom9.org/showthread.php?p=1707765#post1707765

LOG = "MyLog.txt" COUNTER = "MyCounter.txt"
CNT = (Exist(COUNTER) ? RT_NumberValue(RT_ReadTxtFromFile(COUNTER,Lines=1)) : 0) + 1
RT_Writefile(LOG, "%d ] *** HERE I AM *** @ %s", CNT, RT_LocalTimeString(file=False), Append=True)
RT_Writefile(COUNTER, "%d", CNT, Append=False)

# ...

Colorbars.KillAudio.Trim(0,-10).ConvertToYV12 # Your Script (only 10 frames)

# ...

ScriptClip("""
(current_frame==FrameCount-1)
\ ? RT_Writefile(LOG, "%d ] *** LAST FRAME, CLOSING SCRIPT *** @ %s", CNT, RT_LocalTimeString(file=False), Append=True)
\ : NOP
Return Last
""")
Return Last


Need to make sure that LOG and COUNTER files do not exist before start.

This is result after updating to current developer build a few moments ago.

# Loading avs into MeGUI
1 ] *** HERE I AM *** @ 2016-11-10 20:29:52.609
2 ] *** HERE I AM *** @ 2016-11-10 20:29:53.406
# Click Aspect Ratio Select close button
# ----
# Click AutoEncode button
3 ] *** HERE I AM *** @ 2016-11-10 20:31:17.546
# Click Start
4 ] *** HERE I AM *** @ 2016-11-10 20:32:08.296
5 ] *** HERE I AM *** @ 2016-11-10 20:32:09.281
5 ] *** LAST FRAME, CLOSING SCRIPT *** @ 2016-11-10 20:32:09.343
# Seems to finish then reopen again
6 ] *** HERE I AM *** @ 2016-11-10 20:32:10.234

Above, I paused before moving onto next stage.
Perhaps you can compare with MeGUI log to see what its doing at what times.
(I did not use L-Smash, might want to modify script).

The number of re-opens seems to have been reduced since last I tried, was about 7 opens on initial scan, and then another 5
on AutoEncode/render.

EDIT: Number of re-opens probably depend upon options selected in MeGUI.

[jriker1]

Do a preview of your source, though. L-Smash's fpsnum/fpsden-conversion can get stuttery. Often AssumeFPS() is enough to do the trick because the source isn't really vfr.

You are right on. I did in avisynth:

LWLibavVideoSource("Video.mkv", fpsnum=24000, fpsden=1001)
TextSub("Video.ass")

Output stutters. Really wondering the stability of this tool. Switched to it because referenced before getting these weird white frames flashing on the screen during fast transitions and was wondering if it would help but seems problematic. I'll try removing fpsnum and fpsden and adding .AssumeFPS() to the end of the LWLibavVideoSource line and see if that works.

Thanks.

JR

[Thunderbolt8]

Indexing should only happen if there is no existing index file already (I believe it does not even check if the file date of the source is newer than the file date of the index).

Is there any possible reason that L-SMASH Source may not be able to identify the index file matching the name of the source file (e.g. non-latin characters, access rights, file attributes)?no this shouldnt be the problem.

when I opened the script and it created the index file, when I add this file then to the encoding queue then its fine and its not gonna be created again. but when I load the script again even though the index file already exists then it will be created again.

[LigH]

There might be a feature to delete the index in some cases because L-SMASH Source has no sanity checks, and it happened often that a remaining index file from a previous job was re-used on a different new source, but with the same file name, which caused issues.

[tuanden0]

I have a problem with L-Smash Source of latest meGUI dev server update.

They detect my video fps 23.976 to 25.850 or 23.810 :( I tried use AsumeFPS(2400, 1001) but the fps of output didn't change :( My output video just 25.850.

This is my script

SetFilterMTMode("DEFAULT_MT_MODE", 2)
SetFilterMTMode("LSMASHVideoSource", 3)
LoadPlugin("E:\Encoder\Tools\LSMASHSource.dll")
LWLibavVideoSource("E:\Download\CG\CCNA Network Cisco 480p.mkv")
AsumeFPS(2400, 1001)
Toon(0.7)
SetFilterMTMode("Deblock", 1)
Deblock(quant=33, bOffset=2)
DeHalo_Alpha()
Prefetch(4)


Sorry for my bad English

[Music Fan]

That's 24000, 1001, not 2400, 1001, you forgot a 0. Anyway you shouldn't get 25.850 fps with this setting :confused:

[dipje]

And it's AssumeFPS with two s at the start instead of AsumeFPS.

So I'm guessing that script gives an error so whatever he's seeing, it's an old version of his script or he's even picking the wrong or something. Or a 'cache' in whatever editor you're using?

[tuanden0]

Yay, I change AsumeFPS(2400, 1001) to AssumeFPS(24000, 1001) and it's work. Thank you! :sly::sly::sly:

[jriker1]

Yay, I change AsumeFPS(2400, 1001) to AssumeFPS(24000, 1001) and it's work. Thank you! :sly::sly::sly:

Why not just do AssumeFPS(23.976) ?

[jriker1]

Does LWLibavVideoSource support 4k content? I opened a video in VDub using LWLibavVideoSource pointing to the source file and comes out with a lot of green lines with slight hazy view of the video in the background that you can see in between the green lines.

Thanks.

JR

[sneaker_ger]

Your source is using a bit-depth higher than 8 bit. You can instruct l-smash to dither it down via format="YUV420P8" parameter. (See README included in L-Smash package and AviSynth docs (http://avisynth.nl/index.php/High_bit-depth_Support_with_Avisynth))

[jriker1]

Your source is using a bit-depth higher than 8 bit. You can instruct l-smash to dither it down via format="YUV420P8" parameter. (See README included in L-Smash package and AviSynth docs (http://avisynth.nl/index.php/High_bit-depth_Support_with_Avisynth))

Thanks for the suggestion. Thinking for my workflow that may not be an option (though you didn't know this piece). Since I run all my footage thru a light touch with NeatVideo, doing as you suggest will probably alter the noise footprint making cleanup not as efficient. Probably even though I've had recent issues with it, need to go to ffmpegsource2 for this piece of footage.

Thanks.

JR

[sneaker_ger]

What do you believe ffmpegsource2 will do to your footage?

[jriker1]

What do you believe ffmpegsource2 will do to your footage?

Is it doing the same thing automagically?

[sneaker_ger]

Yes, it is.

[jriker1]

OK, in that case did as suggested and came up correctly.

Thanks!!

[StainlessS]

Why not just do AssumeFPS(23.976) ?

Because 24000,1001 is more accurate, ie
on my calculator 24000/1001 produces 23.97602398,
23.976 is rounded value. :eek:

[LigH]

It's an infinite periodical decimal fraction:
______
24 : 1001 = 0.023976

P.S.:
Are there any plans to include .mpls (Blu-ray playlist) support as input in LWLibavVideoSource? (would be a 'nice to have' feature)

I already asked a similar question in the FFMS2 thread, 4 years ago, regarding DGMPGDec index files (*.d2v), which PGCDemux can produce as well. It was already an unresolved issue for long in their bug/wish tracker at this time.

With the development of AviSynth+, converters are moving towards 64 bit. But the support for VOB segments vanishes as DGMPGDec is not ported as well. And Blu-ray playlists are a quite similar field of use.

[videoh]

DGDecNV supports MPLS playlists. It's not difficult to support.

[LigH]

But requires an Nvidia card. L-SMASH Works instead is a software-only source plugin.

[videoh]

I was just pointing out that for DG tools your logic here is perhaps a stretch. That there is no "official" 64-bit DGMPGDec is irrelevant. The code to support MPLS is not at all difficult. I'll even offer the code to any developer that wants it.