hj/pleroma
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

robots.txt

Browse source 
Add default robots.txt that allows bots access to all paths.
Add mix task to generate robots.txt taht allows bots access to no paths.
Document custom emojis, MRF and static_dir
static_dir documentation includes docs for the robots.txt Mix task.
This commit is contained in:
William Pearson 2019-01-20 01:44:00 +00:00
commit 3dadaa4432
7 changed files with 191 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

2
priv/static/robots.txt Normal file
View file

@ -0,0 +1,2 @@
User-Agent: *
Disallow: