srid/zulip-archive

Add Sitemap File

Open

#10 opened on Feb 3, 2020

 (0 comments) (1 reaction) (0 assignees)Haskell (1 fork)github user discovery
enhancementhacktoberfest

Repository metrics

Stars
 (13 stars)
PR merge metrics
 (No merged PRs in 30d)

Description

A sitemap of all the threads would help crawlers and improve search engine discovery. You can point crawlers to the sitemap using the Sitemap: <full-url> directive in a robots.txt file, or by sending them a ping. A sitemap can have a maximum of 50,000 URLs. Beyond that, you need to generate a sitemap index file that points to the different sitemaps.

Not sure if this is a rib issue or a zulip-archive issue, but you could leverage this package I published recently to build the sitemaps and sitemap index: https://hackage.haskell.org/package/sitemap-gen

Contributor guide