1. Home
  2. Blog
  3. Releases

referer-parser now with Java, Scala and Python support

Happy New Year all! It’s been three months since we introduced our Attlib project, now renamed to referer-parser, and we are pleased to announce that referer-parser is now available in three additional languages: Java, Scala and Python.

To recap: referer-parser is a simple library for extracting seach marketing attribution data from referer (sic) URLs. You supply referer-parser with a referer URL; it then tells you whether the URL is from a search engine – and if so, which search engine it is, and what keywords the user supplied to arrive at your page.

Huge thanks to Don Spaulding @ Mirus Research for contributing the Python port of referer-parser; the Java/Scala port was developed by us in-house and it will be a key addition to our Snowplow ETL process in the coming months.

You can checkout the code on GitHub, in the referer-parser repository, or read on below the fold for some code examples in the new languages:


To use referer-parser from a Python script:

from referer_parser import Referer referer_url = 'http://www.google.com/search?q=gateway+oracle+cards+denise+linn&hl=en&client=safari' r = Referer(referer_url) print(r.known) # True print(r.referer) # 'Google' print(r.search_parameter) # 'q' print(r.search_term) # 'gateway oracle cards denise linn' print(r.uri) # ParseResult(scheme='http', netloc='www.google.com', path='/search', params='', query='q=gateway+oracle+cards+denise+linn&hl=en&client=safari', fragment='')

For more information, please see the Python README.


To use referer-parser from a Scala app:

val refererUrl = "http://www.google.com/search?q=gateway+oracle+cards+denise+linn&hl=en&client=safari" import com.snowplowanalytics.refererparser.scala.Parser for (r <- Parser.parse(refererUrl)) { println(r.referer.name) // => "Google"  for (s <- r.search) { println(s.term) // => "gateway oracle cards denise linn"  println(s.parameter) // => "q"  } }

For more information, please see the Java/Scala README.

Usage: Java

To use referer-parser from a Java program:

import com.snowplowanalytics.refererparser.Parser<span class="o">; ... String refererUrl = "http://www.google.com/search?q=gateway+oracle+cards+denise+linn&hl=en&client=safari"<span class="o">; Parser refererParser = new Parser<span class="o">(); Referal r = refererParser.parse(refererUrl<span class="o">); System.out.println(r.referer.name<span class="o">); // => "Google"  System.out.println(r.search.parameter<span class="o">); // => "q"  System.out.println(r.search.term<span class="o">); // => "gateway oracle cards denise linn"

For more information, please see the Java/Scala README.

Getting help

That’s it! If you have any problems with the new versions of referer-parser, please raise an issue or get in touch with us via the usual channels.

And do let us know if you find referer-parser useful!

More about
the author

Alex Dean
Alex Dean

Alex is the Co-founder and CEO of Snowplow.

View author

Ready to start creating rich, first-party data?

Image of the Snowplow app UI