Welcome to Doom9's Forum, THE in-place to be for everyone interested in DVD conversion.

Before you start posting please read the forum rules. By posting to this forum you agree to abide by the rules.

 

Go Back   Doom9's Forum > Video Encoding > MPEG-4 AVC / H.264

Reply
 
Thread Tools Search this Thread Display Modes
Old 15th June 2014, 15:07   #1  |  Link
LoRd_MuldeR
Software Developer
 
LoRd_MuldeR's Avatar
 
Join Date: Jun 2005
Location: Last House on Slunk Street
Posts: 13,275
x264 repository inconsistency [solved]

When I tried to update my local x264 repository recently, I noticed a zillion of merge errors during the "pull" operation.

First I was not sure what caused this and simply made a fresh "clone" from the official repo at Videolan.org

But then I compared the fresh clone to an older backup copy (from around Jan 2014) and I noticed that apparently all the commit SHA-1 hashes had been changed:




To my understanding of Git, this is never supposed to happen!

Or in other words: In Git you cannot change the history of a project, without changing all the hashes and thus this cannot be done unnoticed.

So this means that, apparently, somebody has messed with the repository


Does anybody know what's going on there? Has the Videolan x264 repository been hacked or did they change something intentionally? Or do I miss something?

------------------------------------------

Update: The x264 Git history has been rewritten, but all is okay!

See also:
__________________
Go to https://standforukraine.com/ to find legitimate Ukrainian Charities 🇺🇦✊

Last edited by LoRd_MuldeR; 15th June 2014 at 16:44.
LoRd_MuldeR is offline   Reply With Quote
Old 15th June 2014, 15:52   #2  |  Link
Groucho2004
 
Join Date: Mar 2006
Location: Barcelona
Posts: 5,034
There are apparently two different version (2431) depending on when you checked them out:
0.142.2431M a5831aa
0.142.2431M ac76440

The only difference as far as I can see is the name change in all files from "Jason Garrett-Glaser" to "Fiona Glaser".

Not sure if it's related.

Last edited by Groucho2004; 15th June 2014 at 21:23. Reason: typo
Groucho2004 is offline   Reply With Quote
Old 15th June 2014, 16:05   #3  |  Link
LoRd_MuldeR
Software Developer
 
LoRd_MuldeR's Avatar
 
Join Date: Jun 2005
Location: Last House on Slunk Street
Posts: 13,275
Quote:
Originally Posted by Groucho2004 View Post
There are apparently two different version (2431) depending on when you checked them out:
0.142.2431M a5831aa
0.142.2431M ac76440
That exactly the point!

In Git, each commit (or "version") is identified by a unique SHA-1 hash. And that hash not only depends on the commit itself, but also on it's parent commit (or the "predecessor version"). Consequently, the SHA-1 hash of each commit recursively depends on all the previous commits, i.e. it depends on the complete history of the project. This has the nice effect that in Git it is impossible to change (or insert) a commit retrospectively. At least not without messing up the SHA-1 hash of that commit and and the hashes of all the subsequent commits - which can be easily noticed. If, for example, some attacker had access to the kernel.org server and inserted a backdoor into Linux, everybody would notice this the next morning.

So, apparently, somebody has messed with the x264 repository and all the commits (including the latest one) now have a different hash - which also means that they are different!


Quote:
Originally Posted by Groucho2004 View Post
The only difference as far as I can see is the name change in all files from "Jason Garret Glaser" to "Fiona Glaser".
That would definitely explain it!

Still it would be strange and very unusual to make such a change by overwriting/changing the complete history of the project, instead of just making a regular commit

(Only reason I can think of is that they wanted to enforce that the "new" name not only appears in the current version, but also in all previous versions)
__________________
Go to https://standforukraine.com/ to find legitimate Ukrainian Charities 🇺🇦✊

Last edited by LoRd_MuldeR; 15th June 2014 at 16:22.
LoRd_MuldeR is offline   Reply With Quote
Old 15th June 2014, 16:16   #4  |  Link
Guest
Guest
 
Join Date: Jan 2002
Posts: 21,901
Or maybe someone doesn't like Jason, and has hacked it.

https://www.google.com/search?q=Fiona+Glaser&ie=utf-8&oe=utf-8&aq=t&rls=org.mozilla:en-USfficial&client=firefox-a&channel=rcs

Don't look at me!

I hope they have good backups.
Guest is offline   Reply With Quote
Old 15th June 2014, 16:22   #5  |  Link
MasterNobody
Registered User
 
Join Date: Jul 2007
Posts: 559
There was no hacks so don't panic. The git history was rewritten - yes. And pushed with forced update. One more time: all is ok.
MasterNobody is offline   Reply With Quote
Old 15th June 2014, 16:26   #6  |  Link
LoRd_MuldeR
Software Developer
 
LoRd_MuldeR's Avatar
 
Join Date: Jun 2005
Location: Last House on Slunk Street
Posts: 13,275
I compared the current repository to my backup and it turns out that up to October 2007 nothing has changed. The first differing commit is this one:

Code:
SHA-1: 22455694153d43a9f85837db6eee641ebc4dcdb6

* use hex instead of dia for rdo mv refinement. ~0.5% lower bitrate at subme=7.
patch by Fiona Glaser.


git-svn-id: svn://svn.videolan.org/x264/trunk@681 df754926-b1dd-0310-bc7b-ec298dee348c
Code:
SHA-1: 7da80e549051583d23d8f503665c0fb660b695bb

* use hex instead of dia for rdo mv refinement. ~0.5% lower bitrate at subme=7.
patch by Dark Shikari.


git-svn-id: svn://svn.videolan.org/x264/trunk@681 df754926-b1dd-0310-bc7b-ec298dee348c
__________________
Go to https://standforukraine.com/ to find legitimate Ukrainian Charities 🇺🇦✊
LoRd_MuldeR is offline   Reply With Quote
Old 15th June 2014, 16:32   #7  |  Link
LoRd_MuldeR
Software Developer
 
LoRd_MuldeR's Avatar
 
Join Date: Jun 2005
Location: Last House on Slunk Street
Posts: 13,275
Quote:
Originally Posted by MasterNobody View Post
There was no hacks so don't panic. The git history was rewritten - yes. And pushed with forced update. One more time: all is ok.
Okay, thank you for confirmation! Still seems like an unusual step to me
__________________
Go to https://standforukraine.com/ to find legitimate Ukrainian Charities 🇺🇦✊

Last edited by LoRd_MuldeR; 15th June 2014 at 16:43.
LoRd_MuldeR is offline   Reply With Quote
Old 15th June 2014, 16:33   #8  |  Link
Daemon404
Registered User
 
Join Date: Mar 2005
Posts: 129
x264 was not hacked, Jason changed his name.

If you need a mapping of hashes from old to new: https://mailman.videolan.org/pipermail/x264-devel/2014-June/010683.html

You can take off your tinfoil hats now

Edit: I was late, woops!
Daemon404 is offline   Reply With Quote
Old 15th June 2014, 16:41   #9  |  Link
Guest
Guest
 
Join Date: Jan 2002
Posts: 21,901
Quote:
Originally Posted by LoRd_MuldeR View Post
Okay, thank you for confirmation! Still seems like an usual step to me
Did you mean unusual?
Guest is offline   Reply With Quote
Old 15th June 2014, 16:43   #10  |  Link
LoRd_MuldeR
Software Developer
 
LoRd_MuldeR's Avatar
 
Join Date: Jun 2005
Location: Last House on Slunk Street
Posts: 13,275
Quote:
Originally Posted by neuron2 View Post
Did you mean unusual?
yes
__________________
Go to https://standforukraine.com/ to find legitimate Ukrainian Charities 🇺🇦✊
LoRd_MuldeR is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +1. The time now is 09:28.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2026, vBulletin Solutions Inc.