CommonCrawl Index Server

Please see CDX Server API Reference for more examples on how to use the query api.

The CommonCrawl Index Client provides command-line tools for using this api.

Currently available index collections:

/CC-MAIN-2017-26 (June 2017 Index) (api endpoint: /CC-MAIN-2017-26-index)
/CC-MAIN-2017-22 (May 2017 Index) (api endpoint: /CC-MAIN-2017-22-index)
/CC-MAIN-2017-17 (April 2017 Index) (api endpoint: /CC-MAIN-2017-17-index)
/CC-MAIN-2017-13 (March 2017 Index) (api endpoint: /CC-MAIN-2017-13-index)
/CC-MAIN-2017-09 (February 2017 Index) (api endpoint: /CC-MAIN-2017-09-index)
/CC-MAIN-2017-04 (January 2017 Index) (api endpoint: /CC-MAIN-2017-04-index)
/CC-MAIN-2016-50 (December 2016 Index) (api endpoint: /CC-MAIN-2016-50-index)
/CC-MAIN-2016-44 (October 2016 Index) (api endpoint: /CC-MAIN-2016-44-index)
/CC-MAIN-2016-40 (September 2016 Index) (api endpoint: /CC-MAIN-2016-40-index)
/CC-MAIN-2016-36 (August 2016 Index) (api endpoint: /CC-MAIN-2016-36-index)
/CC-MAIN-2016-30 (July 2016 Index) (api endpoint: /CC-MAIN-2016-30-index)
/CC-MAIN-2016-26 (June 2016 Index) (api endpoint: /CC-MAIN-2016-26-index)
/CC-MAIN-2016-22 (May 2016 Index) (api endpoint: /CC-MAIN-2016-22-index)
/CC-MAIN-2016-18 (April 2016 Index) (api endpoint: /CC-MAIN-2016-18-index)
/CC-MAIN-2016-07 (February 2016 Index) (api endpoint: /CC-MAIN-2016-07-index)
/CC-MAIN-2015-48 (November 2015 Index) (api endpoint: /CC-MAIN-2015-48-index)
/CC-MAIN-2015-40 (September 2015 Index) (api endpoint: /CC-MAIN-2015-40-index)
/CC-MAIN-2015-35 (August 2015 Index) (api endpoint: /CC-MAIN-2015-35-index)
/CC-MAIN-2015-32 (July 2015 Index) (api endpoint: /CC-MAIN-2015-32-index)
/CC-MAIN-2015-27 (June 2015 Index) (api endpoint: /CC-MAIN-2015-27-index)
/CC-MAIN-2015-22 (May 2015 Index) (api endpoint: /CC-MAIN-2015-22-index)
/CC-MAIN-2015-18 (April 2015 Index) (api endpoint: /CC-MAIN-2015-18-index)
/CC-MAIN-2015-14 (March 2015 Index) (api endpoint: /CC-MAIN-2015-14-index)
/CC-MAIN-2015-11 (February 2015 Index) (api endpoint: /CC-MAIN-2015-11-index)
/CC-MAIN-2015-06 (January 2015 Index) (api endpoint: /CC-MAIN-2015-06-index)
/CC-MAIN-2014-52 (December 2014 Index) (api endpoint: /CC-MAIN-2014-52-index)
/CC-MAIN-2014-49 (November 2014 Index) (api endpoint: /CC-MAIN-2014-49-index)
/CC-MAIN-2014-42 (October 2014 Index) (api endpoint: /CC-MAIN-2014-42-index)
/CC-MAIN-2014-41 (September 2014 Index) (api endpoint: /CC-MAIN-2014-41-index)
/CC-MAIN-2014-35 (August 2014 Index) (api endpoint: /CC-MAIN-2014-35-index)
/CC-MAIN-2014-23 (July 2014 Index) (api endpoint: /CC-MAIN-2014-23-index)
/CC-MAIN-2014-15 (April 2014 Index) (api endpoint: /CC-MAIN-2014-15-index)
/CC-MAIN-2014-10 (March 2014 Index) (api endpoint: /CC-MAIN-2014-10-index)
/CC-MAIN-2013-48 (Winter 2013 Index) (api endpoint: /CC-MAIN-2013-48-index)
/CC-MAIN-2013-20 (Summer 2013 Index) (api endpoint: /CC-MAIN-2013-20-index)