Auto-Updating Data with AWS’s New Data Exchange Tool

Developers frequently rely on a third-party data set to create machine learning models, which they then include into their model. Data, though, isn’t always static. This implies generating some sort of conveyance system to acquire the data at preset intervals, adding complexity.

The company announced the AWS Data Exchange for APIs today at AWS re:Invent in Las Vegas, a new tool that automatically updates changing third-party APIs and eliminates the need to build the mechanism.

The use of an API allows data scientists to acquire a response to a precise query with changing information, such as a stock price rapidly, eliminating the need for the pipeline. That’s wonderful for a single API, but if you’re using many APIs, you’ve got another set of issues to deal with when it comes to communication, authentication, and governance around them.

Finally, we wanted to show you how to use AWS Data Exchange for APIs to solve these problems.“Today, I’m happy to announce the general availability of AWS Data Exchange for APIs, a new capability that lets you find, subscribe to, and use third-party APIs with a consistent access using AWS SDKs, as well as consistent AWS-native authentication and governance,” Casalboni wrote in the blog post.

The most exciting thing about this announcement is that it’s AWS-specific, much like many other tools released this week. If you’re building an application or data modeling on top of AWS, you can use these tools to access and update third-party APIs in an automated way thanks to the integration of AWS SDKs and access management functionality.

Third-party data providers also benefit. More developers can discover and utilize their data sources by placing their APIs in the Data Exchange catalog.

“As a data provider, you make your API discoverable by millions of AWS customers by listing it in the AWS Data Exchange catalog using an OpenAPI specification and fronting it with an Amazon API Gateway endpoint,” Casalboni explained.

Variety Business Intelligence, IMDb, and Foursquare are just a few of the third-party providers that provide data through the data exchange. The application is now available to both developers and API providers.