3 Commits

Author	SHA1	Message	Date
Sergey Chebotar	57f7cb28a5	Move RobotsTxtGenerator class to separate file	2023-06-14 08:03:29 +03:00
Sergey Chebotar	fc5c75131c	Edit robots.txt	2023-06-14 08:02:48 +03:00
Sergey Chebotar	a5bf29c00b	Add robots.txt generator	2023-06-14 07:45:14 +03:00