Home

Customized Web Mining Solutions

We use our Bixolabs elastic web mining™ platform to quickly build customized solutions that solve your web mining problems.

Our elastic web mining platform is:

  • EASY because it provides a pre-configured, tested and expertly managed web crawling and data processing system. Customization happens at the exact points where you have specific knowledge and requirements for actions beyond the acquisition and storage of data.
  • FAST because it scales to the size of your data, via dynamic clusters. Bigger jobs automatically get larger server clusters.
  • COST EFFECTIVE because you don’t need to build your own web mining system or buy, configure and maintain a cluster of servers.

Web Mining Examples

Two of the most common uses for web mining are content aggregation and price analytics.

Content Aggregation is the collection of public information from known web sites, which is then re-published by the aggregator. Typical examples of this include job boards, product reviews, special offers, travel destinations, etc.

Price Analytics is the collection and analysis of pricing data found on public web pages. This is sometimes also known as shopping cart analysis. The final product of this analysis has high value for determining pricing trends, setting competitive prices, and discovering price disparities.

Services

A typical customer engagement has four steps:

  • Understand the web mining, data processing, and customization requirements.
  • Define and implement a small proof-of-concept (PoC) web mining app.
  • Define and implement the production version, using data from PoC test runs.
  • Run the production web mining app to generate datasets at specified intervals.

Following deployment of the complete solution, you and your team have flexibility to independently change any of the customization points, using either Java or popular scripting languages.

Pricing

  • Hourly rates for defining and implementing the proof-of-concept and production web mining applications. Rates range from $60/hr to $125/hr, depending on the required level of expertise.
  • Fixed monthly fee for running, monitoring and validating the production web mining application. This ranges from $1K/month for a simple web mining application to more than $10K/month for complex, high volume applications.
  • Variable monthly fee for bandwidth, storage and processing costs based on usage. These are typically less than $300/month.