IndexNow & Search Engine Pinging Tools
Relevant source files
The following files were used as context for generating this wiki page:
IndexNow and Search Engine Pinging Tools notify search engines like Bing, Yandex, and DuckDuckGo about recent website updates to ensure instant indexing. These tools automate the communication between the Sunrise Communication web platform and search crawler queues, replacing traditional slow crawling with push-based notifications.
System Architecture and Integration
The indexing system utilizes a combination of static manifests, script-based pings, and service-level metadata management. The ping-indexnow.js script serves as the primary execution point for manual or automated indexing requests.
The following diagram illustrates the flow of a notification from the local script to external search engine APIs:
The script sends a list of canonical URLs to the IndexNow API, which validates the request using a key file hosted on the server.
Sources: sunrise-angular/scripts/ping-indexnow.js:6-40, sunrise-angular/public/robots.txt:77-80
IndexNow Configuration
The IndexNow implementation requires specific credentials and a predefined list of high-priority URLs. The ping-indexnow.js script contains these configurations to facilitate a secure POST request to api.indexnow.org.
Configuration Parameters
| Parameter | Value / Description |
|---|---|
| Host | sunrisecommunication.in |
| Key | d7a489fc93b6480c85e263ab21e3f890 |
| Key Location | https://sunrisecommunication.in/d7a489fc93b6480c85e263ab21e3f890.txt |
| API Endpoint | https://api.indexnow.org/indexnow |
| Content Type | application/json; charset=utf-8 |
Sources: sunrise-angular/scripts/ping-indexnow.js:8-35
Target URL List
The system notifies search engines about core business routes and service-specific endpoints.
https://sunrisecommunication.in/https://sunrisecommunication.in/productshttps://sunrisecommunication.in/services/cctv-surveillance-systemshttps://sunrisecommunication.in/services/epabx-intercom-solutionshttps://sunrisecommunication.in/services/biometric-access-controlhttps://sunrisecommunication.in/services/structured-networking-cabling
Sources: sunrise-angular/scripts/ping-indexnow.js:12-22
Discovery Layer & Search Infrastructure
The project supports search engine discovery through structured machine-readable files located in the public/ directory. These files inform both traditional search bots and modern AI agents about the site structure.
Sitemap Management
The public/sitemap.xml file provides a map of all pages, including priority levels for crawling.
- Priority 1.0: Home Page
- Priority 0.95: Core Service Clusters (e.g., CCTV, EPABX)
- Priority 0.9: Product Catalog and Technical Guides
Sources: sunrise-angular/public/sitemap.xml:1-80, task.md:46-46
Robot Instructions
The robots.txt file defines access permissions for specific crawlers, including explicit permissions for AI and LLM agents like GPTBot, ClaudeBot, and PerplexityBot. It also points to indexing manifests.
The discovery infrastructure ensures that both standard and agentic search engines can access relevant indexing data.
Sources: sunrise-angular/public/robots.txt:40-80, task.md:15-18
SEO Service Integration
The SeoService refactors metadata to output a unified JSON-LD @graph. This service manages canonical URLs, which are subsequently used in the IndexNow ping list to ensure search engines index the correct, non-duplicate versions of pages.
Sources: sunrise-angular/src/app/core/services/seo.service.ts:245-258, implementation_plan.md:144-155
Execution Logic
The ping-indexnow.js script uses the Node.js https module to perform the ping.
- Constructs a JSON payload containing the host, key, and URL list.
- Calculates
Content-Lengthfor the headers. - Sends a
POSTrequest toapi.indexnow.org. - Logs the response status; a code of
200or202indicates successful queuing by Bing and partner engines.
Sources: sunrise-angular/scripts/ping-indexnow.js:24-60
Conclusion
The IndexNow and Search Engine Pinging Tools are critical for maintaining the visibility of Sunrise Communication's high-intent service clusters and product catalogs. By combining proactive pings with structured discovery manifests like sitemap.xml and robots.txt, the project ensures that search engines and AI agents reflect site changes in real-time.