CommonCrawl Index Server

Please see CDX Server API Reference for more examples on how to use the query api.

The CommonCrawl Index Client provides command-line tools for using this api.

Currently available index collections:

/CC-MAIN-2016-36 (August 2016 Index) (api endpoint: /CC-MAIN-2016-36-index)
/CC-MAIN-2016-30 (July 2016 Index) (api endpoint: /CC-MAIN-2016-30-index)
/CC-MAIN-2016-26 (June 2016 Index) (api endpoint: /CC-MAIN-2016-26-index)
/CC-MAIN-2016-22 (May 2016 Index) (api endpoint: /CC-MAIN-2016-22-index)
/CC-MAIN-2016-18 (April 2016 Index) (api endpoint: /CC-MAIN-2016-18-index)
/CC-MAIN-2016-07 (February 2016 Index) (api endpoint: /CC-MAIN-2016-07-index)
/CC-MAIN-2015-48 (November 2015 Index) (api endpoint: /CC-MAIN-2015-48-index)
/CC-MAIN-2015-40 (September 2015 Index) (api endpoint: /CC-MAIN-2015-40-index)
/CC-MAIN-2015-35 (August 2015 Index) (api endpoint: /CC-MAIN-2015-35-index)
/CC-MAIN-2015-32 (July 2015 Index) (api endpoint: /CC-MAIN-2015-32-index)
/CC-MAIN-2015-27 (June 2015 Index) (api endpoint: /CC-MAIN-2015-27-index)
/CC-MAIN-2015-22 (May 2015 Index) (api endpoint: /CC-MAIN-2015-22-index)
/CC-MAIN-2015-18 (April 2015 Index) (api endpoint: /CC-MAIN-2015-18-index)
/CC-MAIN-2015-14 (March 2015 Index) (api endpoint: /CC-MAIN-2015-14-index)
/CC-MAIN-2015-11 (February 2015 Index) (api endpoint: /CC-MAIN-2015-11-index)
/CC-MAIN-2015-06 (January 2015 Index) (api endpoint: /CC-MAIN-2015-06-index)
/CC-MAIN-2014-52 (December 2014 Index) (api endpoint: /CC-MAIN-2014-52-index)