Skip to main content

Git-SVN Mirror for multiple branches

This post is part of a series on Git and Subversion. To see all the related posts, screencasts and other resources, please click here

This extends the posts where I explained how to set up a git-svn mirror for a single directory.

NOTE: If you just want to use Git against a SVN repo on your own, stop reading ,now, and stick to the git-svn basics. However, if you want a setup where you can share a Git repository with colleagues and friends while still interfacing with Subversion, keep reading.

I'll show how to set up a git-svn mirror for a standard Subversion project with trunk, branches and tags. It's a bit like the single directory mirror, but in order to keep all branches in sync, it's a bit more fiddling. The good part is that this setup enables us to cherry-pick commits from one branch to the other. This is slightly smoother than using svn merge.

First of all, let's repeat how our Subversion and Git-repositories look physically (roughly the same as in previous posts):
We'll set this up in the following order.

  1. Clone a fresh Git repo from Subversion. This will be our fetching repo.
  2. Set up a bare repo.
  3. Configure pushing from the fetching repo to bare repo
  4. In the shoes of a developer, clone the repo
  5. Set up an SVN remote in the developer's repo


You'll need to have a Subversion repository url that points to a project with trunk and branches like this (we'll skip tags for the purpose of this how-to):

file:///svn-repos/company-repo/websites/trunk
file:///svn-repos/company-repo/websites/branches/yksi
file:///svn-repos/company-repo/websites/branches/kaksi

We'll do our development in trunk, and every time we make a release we branch out (so far we've released yksi and kaksi).

1. Clone the Subversion repo

Do the following:

tfnico@flint:~/git-repos/>git svn clone -s file:///svn-repos/company-repo/websites

This will run for a while (depending on the size of your repo), and create a websites directory. This will be our fecthing repo. The -s flag means "standard layout", and tells git-svn to scan the trunk and branches structure.

We can poll for changes from the SVN repo like this:

tfnico@flint:~/git-repos/websites>git svn fetch

2. Set up a bare repo

Create the bare repo like this:

tfnico@flint:~/git-repos/>git init --bare websites.git

In the next step we'll configure the fetching repo to push changes into this one.

3. Configure fetching repo to push changes

Now there are a lot of different ways to do this, but this is the easiest workflow I've found so far.

First, go into the fetching repo and set up the newly created bare repo as a remote repo with the alias 'origin':

tfnico@flint:~/git-repos/websites/>git remote add origin ../websites.git/

Now, if you look inside the fetching repo's config in : git-repos/websites/.git/config
you'll see the following entry:


[remote "origin"]
    url = ../websites.git/
    fetch = +refs/heads/*:refs/remotes/origin/*

Now modify the above so it looks like the config below:

[remote "origin"]
    url = ../websites.git/
    fetch = +refs/remotes/*:refs/remotes/origin/*
    push = refs/remotes/*:refs/heads/*


I won't explain the details of this, but we've changed the fetch operations to update the remote branches. We've also added a push configuration, saying that all remote branches should be pushed.

We can now push the remote branches into the bare repo:


tfnico@flint:~/git-repos/websites>git push origin


We can update with changes from SVN and push to the repo in one go:


tfnico@flint:~/git-repos/websites>git svn fetch; git push origin


You'll want to automate these steps somewhat, so that they occur regularly in a cron-job, or as an svn commit hook.

Update (21.08.2012): Set trunk as the default branch to be cloned:

tfnico@flint:~/git-repos/websites>cd ../websites.git
tfnico@flint:~/git-repos/websites.git>git symbolic-ref HEAD refs/heads/trunk

We are now done with setting up the infrastructure. Next up: The developer's clone.

Update (25.09.2011): Instead of doing the last two steps as described below, I recommend you rather jump to my newer recipe that makes things a bit easier

4. Clone the bare repo

Pretty straight forward:

tfnico@flint:~/sources/git/>git clone ~/git-repos/websites.git/

We can now track the remote branches, and pull the latest changes as they come in to the bare repo.

tfnico@flint:~/sources/git/websites/>git checkout -t origin/yksi
tfnico@flint:~/sources/git/websites/>git pull --rebase

(Remember to use --rebase to avoid merge commits in case you have local commits.)

When the time comes to push commits back to Subversion, we have to complete the last step.

5. Set up an SVN remote in the developer's repo

We'll do an svn-init with the same parameters as we cloned in the beginning, like this:

tfnico@flint:~/sources/git/websites/>git svn init -s file:///svn-repos/company-repo/websites/

Before we can do this in the yksi branch, we need to update the pointer to git-svn's awareness of Subversion:

tfnico@flint:~/sources/git/websites/>git update-ref refs/remotes/yksi refs/remotes/origin/yksi


The above command is the biggest PITA with this Git-SVN mirror setup:


After each pull/rebase, before you can push/dcommit back to SVN, you have to update-ref on the respective branch/trunk.


If you don't, you'll get a message like this:

tfnico@flint:~/sources/git/websites/>git svn dcommit
Committing to file:///svn-repos/company-repo/websites/branches/yksi ...
Transaction is out of date: File '/websites/branches/yksi/README.txt' is out of date at /opt/local/libexec/git-core/git-svn line 573


So, to correct the above, repeat this:

tfnico@flint:~/sources/git/websites/>git update-ref refs/remotes/yksi refs/remotes/origin/yksi

It's a bit of hassle, but I'm sure you'll figure out a neat little script for doing this in no time.


Update (20/11): I've figured out a script for you! (or rather the friendly folks on #git did):

Put this in your .gitconfig aliases:


upci = !git update-ref refs/remotes/$(git branch | grep '^*' | awk '{print $2}') refs/remotes/origin/$(git branch|grep '^*'|awk '{print $2}') && git svn dcommit


And from now on use that alias for pushing to SVN.


That brings us through the basics. I would've loved to show this off in a screencast, but unfortunately my Camtasia trial has expired, and I'm not so keen on dishing out euros for this little hobby. And there is no good free screencasting software for Mac.

Popular posts from this blog

Encrypting and Decrypting with Spring

I was recently working with protecting some sensitive data in a typical Java application with a database underneath. We convert the data on its way out of the application using Spring Security Crypto Utilities. It "was decided" that we'd be doing AES with a key-length of 256, and this just happens to be the kind of encryption Spring crypto does out of the box. Sweet!

The big aber is that whatever JRE is running the application has to be patched with Oracle's JCE in order to do 256 bits. It's a fascinating story, the short version being that U.S. companies are restricted from exporting various encryption algorithms to certain countries, and some countries are restricted from importing them.

Once I had patched my JRE with the JCE, I found it fascinating how straight forward it was to encrypt and decrypt using the Spring Encryptors. So just for fun at the weekend, I threw together a little desktop app that will encrypt and decrypt stuff for the given password and sa…

Managing dot-files with vcsh and myrepos

Say I want to get my dot-files out on a new computer. Here's what I do:

# install vcsh & myrepos via apt/brew/etc
vcsh clone https://github.com/tfnico/config-mr.git mr
mr update

Done! All dot-files are ready to use and in place. No deploy command, no linking up symlinks to the files. No checking/out in my entire home directory as a Git repository. Yet, all my dot-files are neatly kept in fine-grained repositories, and any changes I make are immediately ready to be committed:

config-atom.git
    -> ~/.atom/*

config-mr.git
    -> ~/.mrconfig
    -> ~/.config/mr/*

config-tmuxinator.git  
    -> ~/.tmuxinator/*

config-vim.git
    -> ~/.vimrc
    -> ~/.vim/*

config-bin.git   
    -> ~/bin/*

config-git.git          
    -> ~/.gitconfig

config-tmux.git  
    -> ~/.tmux.conf    

config-zsh.git
    -> ~/.zshrc

How can this be? The key here is to use vcsh to keep track of your dot-files, and its partner myrepos/mr for operating on many repositories at the same time.

I discovere…

Always use git-svn with --prefix

TLDR: I've recently been forced back into using git-svn, and while I was at it, I noticed that git-svn generally behaves a lot better when it is initialized using the --prefix option.

Frankly, I can't see any reason why you would ever want to use git-svn without --prefix. It even added some major simplifications to my old git-svn mirror setup.

Update: Some of the advantages of this solution will disappear in newer versions of Git.

For example, make a standard-layout svn clone:

$ git svn clone -s https://svn.company.com/repos/project-foo/

You'll get this .git/config:

[svn-remote "svn"]
        url = https://svn.company.com/repos/
        fetch = project-foo/trunk:refs/remotes/trunk
        branches = project-foo/branches/*:refs/remotes/*
        tags = project-foo/tags/*:refs/remotes/tags/*

And the remote branches looks like this (git branch -a):
    remotes/trunk
    remotes/feat-bar

(Compared to regular remote branches, they look very odd because there is no remote name i…

The Best Log Viewer Ever

This is what it looks like when I want to have a look through the logfile, to see what a user did on one of our machines one day:


Read the whole story about how it works on the Viaboxx Systems blog (and upvote on DZone!).

Microsoft ups their Git efforts another notch

This week Microsoft announced first class Git support embedded in the coming version of Visual Studio.

Now, it's not completely shocking. We could have seen it coming since Microsoft started offering Git repos on CodePlex, and more recently offering a Git client for TFS. In any case, these are some big news. Scott Hanselman weighs on some features and some more background here.

For those who are a bit unaware of what the Git situation on Windows looks like these days, I've dotted down these notes:
Some explanation on these:

msysGit has long been The Way to use Git on Windows. It's basically a port of Git itself, so it's a command-line tool.GitExtensions (includes Visual Studio integration), TortoiseGit, Git Shell, posh-git and most other tools are powered by msysGit.libgit2 is a native library for doing Git stuff. It is developed completely separate from Git itself. The above tools could (and should) probably use libgit2 instead of hooking onto and around msysGit.Github…