Jannik
Jannik4mo ago

indexability of pages

Hi there, we set up AnswerOverflow for our Discord approximately 1.5 months ago. We also have a couple of links pointing from our website to https://discord.langfuse.com/. However, as of now, only 4 pages are indexed by Google. Do you have any best practices that you can share so that more pages get indexed by Google?
Langfuse
Langfuse Community
Langfuse is the open source LLM Engineering Platform. This is our Community Discord.
4 Replies
dan1st
dan1st4mo ago
I guess the issue is Google being very selective with indexing
Rhys
Rhys4mo ago
Hm that’s weird, I’d first try adding a backlink to https://discord.langfuse.com/ from langfuse.com so Google knows the sites are associated
Langfuse
Langfuse Community
Langfuse is the open source LLM Engineering Platform. This is our Community Discord.
Rhys
Rhys4mo ago
If that picks up more pages then that’s good, alternatively we can try serving it from a subdirectory on langfuse.com I.e langfuse.com/q/ and that may help
Myles Scolnick
Myles Scolnick3mo ago
Not sure if it’ll help y’all, but I manually added my sitemap to https://search.google.com/search-console and got everything indexed in a couple days. I would try this out, and @Rhys id recommend adding this somewhere in the docs