Seeking Solutions for Intelligent Web Crawler

Background

Enterprise Singapore (ESG) manages an online tech startup database known as Startup SG Network (SSN) to:

  • Strengthen linkages among the players within the tech startup ecosystem;
  • Become a one-stop portal for information and data for startups, investors and accelerators; and
  • Be the key source of data to draw insights and monitor growth of Singapore’s startup ecosystem.

In order to effectively fulfil the objectives of SSN, the information on SSN needs to be constantly updated with the latest developments in the ecosystem. To establish SSN as the trusted source of information for startups and investors to facilitate partnership and investment opportunities, ensuring that data is accurate and reliable is imperative.

Hence, ESG would like to explore opportunities to harness innovative technologies to automate the data collection and curation for all entities on the SSN platform.

Requirements

This Outcome Based Procurement (please refer to Part 1 Section A Instructions to Tenderers.pdf for details on OBP) seeks to invite interested Tenderer(s) to submit a design proposal for a solution that addresses the following scope:

  1. Extract and provide continual updates to the data points defined by ESG for all entities on SSN from trusted online structured or unstructured sources using, but not limited to, Natural Language Processing (NLP) technology.
  2. Conduct data exchange and integrate with, but not limited to, SSN.
  3. Improve accuracy of the data points updates based on user feedback via machine learning.
  4. Achieve 80% accuracy rate upon production deployment.
  5. Produce curation of insights (refer to Part 2 OBP Specifications.pdf for details).

Apart from submitting the design proposal, Tenderers are encouraged to prepare a demo to demonstrate the capabilities relevant to, but not limited to, web crawling and text mining of unstructured text. Up to 2 shortlisted Tenderers will be required to conduct a Pilot Trial to demonstrate the performance and capability of the proposed solution and its associated technology to meet the requirements set out in this OBP.

A prize money of S$ 50,000 will be given to each shortlisted Tenderer for Pilot Trial.

Upon successful completion of the Pilot Trial, and solely at ESG’s discretion, the selected (1) Tenderer will be required to fully implement the proposed solution based on the requirements set out in this OBP.

Tenderers are required to quote for the System's support and maintenance. The support and maintenance for the System, if such option is elected by ESG, shall be for up to five (5) years, subjected to renewal by ESG on a yearly basis. Such support and warranty services shall commence only after the expiry of the System Warranty Period.

Please also refer to the documents in Attachment:

Part 1
Section A - Instructions to Tenderer
Section B - Conditions of Contract for Pilot Trial
Section C - Conditions of Contract for Final Award
Section D - Conditions of Software Maintenance and Support

Part 2
OBP Specifications

Part 3
Guidelines for OBP Submission

Part 4
Evaluation Criteria

Update: Please refer to the attachments for the corrigendum and revised 7 Part 3 Guidelines for OBP Submission.

Update: Please refer to the attachments for Tender Clarifications set 1.

Update: Please refer to the attachments for Tender Clarifications set 2.

Development Timeframe

  • This OBP comprises two stages, namely Pilot Trial and Full Implementation (Final Award).
  • Depending on the evaluation assessment of the submitted proposals, ESG may select up to two (2) Tenderers to conduct the Pilot Trial.
  • Upon completion of Pilot Trial, and depending on the evaluation assessment of this trial, ESG has the option to extend the project to Full Implementation phase.