Kimono Is A Smarter Web Scraper That Lets You “API-ify” The Web, No Code Required

A new Y Combinator-backed startup called Kimono wants to make it easier to access data from the unstructured web with a point-and-click tool that can extract information from webpages that don’t have an API available. And for non-developers, Kimono plans to eventually allow anyone track data without needing to understand APIs at all.

This sort of smarter “web scraper” idea has been tried before, and has always struggled to find more than a niche audience. Previous attempts with similar services like Dapper or Needlebase, for example, folded. Yahoo Pipes still chugs along, but it’s fair to say that the service has long since been a priority for its parent company.

But Kimono’s founders believe that the issue at hand is largely timing.

“Companies more and more are realizing there’s a lot of value in opening up some of their data sets via APIs to allow developers to build these ecosystems of interesting apps and visualizations that people will share and drive up awareness of the company,” says Kimono co-founder Pratap Ranade. (He also delves into this subject deeper in a Forbes piece here). But often, companies don’t know how to begin in terms of what data to open up, or how. Kimono could inform them.

Plus, adds Ranade, Kimono is materially different from earlier efforts like Dapper or Needlebase, because it’s outputting to APIs and is starting off by focusing on the developer user base, with an expansion to non-technical users planned for the future. (Meanwhile, older competitors were often the other way around).

The company itself is only a month old, and was built by former Columbia grad school companions Ranade and Ryan Rowe. Both left grad school to work elsewhere, with Rowe off to Frog Design and Ranade at McKinsey. But over the nearly half-dozen or so years they continued their careers paths separately, the two stayed in touch and worked on various small projects together.

One of those was Airpapa.com, a website that told you which movies were showing on your flights. This ended up giving them the idea for Kimono, as it turned out. To get the data they needed for the site, they had to scrape data from several publicly available websites.

“The whole process of cleaning that [data] up, extracting it on a schedule…it was kind of a painful process,” explains Rowe. “We spent most of our time doing that, and very little time building the website itself,” he says. At the same time, while Rowe was at Frog, he realized that the company had a lot of non-technical designers who needed access to data to make interesting design decisions, but who weren’t equipped to go out and get the data for themselves.

With Kimono, the end goal is to simplify data extraction so that anyone can manage it. After signing up, you install a bookmarklet in your browser, which, when clicked, puts the website into a special state that allows you to point to the items you want to track. For example, if you were trying to track movie times, you might click on the movie titles and showtimes. Then Kimono’s learning algorithm will build a data model involving the items you’ve selected.

That data can be tracked in real time and extracted in a variety of ways, including to Excel as a .CSV file, to RSS in the form of email alerts, or for developers as a RESTful API that returns JSON. Kimono also offers “Kimonoblocks,” which lets you drop the data as an embed on a webpage, and it offers a simple mobile app builder, which lets you turn the data into a mobile web application.

For developer users, the company is currently working on an API editor, which would allow you to combine multiple APIs into one.

So far, the team says, they’ve been “very pleasantly surprised” by the number of sign-ups, which have reached ten thousand*. And even though only a month old, they’ve seen active users in the thousands.

Initially, they’ve found traction with hardware hackers who have done fun things like making an airhorn blow every time someone funds their Kickstarter campaign, for instance, as well as with those who have used Kimono for visualization purposes, or monitoring the exchange rates of various cryptocurrencies like Bitcoin and dogecoin. Others still are monitoring data that’s later spit back out as a Twitter bot.

Kimono APIs are now making over 100,000 calls every week, and usage is growing by over 50 percent per week. The company also put out an unofficial “Sochi Olympics API” to showcase what the platform can do.

The current business model is freemium based, with pricing that kicks in for higher-frequency usage at scale.

The Mountain View-based company is a team of just the two founders for now, and has initial investment from YC, YC VC and SV Angel.

Source:http://techcrunch.com/2014/02/18/kimono-is-a-smarter-web-scraper-that-lets-you-api-ify-the-web-no-code-required/

Getting Content for Your Site Free and Easy

Any avid website owner knows how critical it is to have a website that contains large amounts of genuine 'content'. These days a website pretty much lives or dies by the amount of content it has on it. A simple and brutal truth of today's Internet is that a site without increasing amounts of frequently updated content is not deemed important enough to merit frequent spidering by the Search Engines.

Successful search engine optimization experts tout that in today's online environment a website is successful because of several sequential steps occurring naturally online. That is...

- increased website content creates more search engine indexing opportunities, which results in more opportunities for organic search engine traffic;

- more search engine traffic leads to more online popularity and subsequently, increased viral online linking;

- this increased linking to a website results in more perceived relevancy by the search engines and, again, higher organic search engine listings; and,

- finally, these higher listings lead to more traffic, and the cycle continues.

So how does a website owner deal with this fact of doing business online? Simple. By providing an ever-increasing amount of content on their website.

But if you own several websites you understand how great a challenge it can be to be able to provide constantly updated, valid and useful content, usually in substantially large quantities via hundreds or thousands of webpages, for your website's visitors and information seekers.

So the way to solve this dilemma for most webmasters is to use content written by others. But the most common route to getting this type of information is to have to pay for a ghostwriter to write the content. This can get expensive so, again, one's website's content volume suffers.

Some webmasters use RSS feeds to scrape content from other websites, but to build static webpages from the scraped content can get into legal issues so this tactic can be rather risky.

And for those webmasters brave enough to write the needed content themselves usually face a difficult mountain to climb. That is, these days it's very tough to actually find the time or have the knowledge to do this. One can only write so many pages on the same topic before experiencing writer's 'burnout'.

So what would be the answer to this apparent dilemma of needing lots of website content but not having lasting viable routes to obtaining the needed content? Simple.

Grab content from free article directories. An article directory is specially designed for website owners and publishers to legally and freely take copyrighted articles, written by online authors willing to share their writings, and post on their website as content.

And one can find hundreds of article directories available on the Internet today and most have only one condition of use: there are terms of usage that website owners agree to follow before using the articles from the article directory. But outside of that there are no other restrictions, and no 'memberships' required.

So, in view of the issues surrounding creating content for one's website, as described above, and the absolutely necessity for a website to have voluminous and fresh content to stay ranked highly in the Search Engines, one can easily see how the free articles found at an article directory can be just the answer a website owner needs to give their websites a needed boost with the Search Engines.

No more having to pay for content. And no more struggling with writing the content yourself. Use whatever information you find at the article directory that you deem relevant and post it on your website, or blog, or forum.

Source:http://ezinearticles.com/?Getting-Content-for-Your-Site-Free-and-Easy&id=99304