Connect with us

Tech News

Google’s AutoFlip uses AI to crop videos for you

Dinu das



Video filmed and edited for TV is usually created and seen in panorama, however problematically, side ratios like 16:9 and four:three don’t all the time match the show getting used for viewing. Fortuitously, Google is on the case. It immediately detailed AutoFlip, an open source device for intelligent video reframing. Given a video and a goal dimension, it analyzes the video content material and develops optimum monitoring and cropping methods, after which it produces an output video with the identical period within the desired side ratio.

As Google Analysis senior software program engineer Nathan Frey and senior software program engineer Zheng Solar observe in a weblog put up, conventional approaches for reframing video normally contain static cropping, which frequently results in unsatisfactory outcomes. Extra bespoke approaches are superior, however they usually require video curators to manually establish salient content material in every body, monitor their transitions from body to border, and modify crop areas accordingly all through the video.

Against this, AutoFlip is totally computerized due to AI object detection and monitoring applied sciences that intelligently perceive video content material. The system detects adjustments within the composition that signify scene adjustments so as to isolate scenes for processing. And inside every shot, it makes use of video evaluation to establish salient content material earlier than reframing the scene, mainly by choosing an optimized digital camera mode and path.

Google AutoFlip

Above: AutoFlip (backside row) in contrast with a baseline technique (prime row).

Picture Credit score: Google

To detect when a shot in a video adjustments, AutoFlip computes the colour histogram of every body and compares this with prior frames. If the distribution of body colours adjustments at a unique charge than a sliding historic window, a shot change is signaled. AutoFlip buffers the video till the scene is full earlier than making reframing choices so as to optimize the reframing for your entire scene.

AutoFlip additionally faucets AI-based object detection fashions to search out fascinating content material within the body, like folks, animals, textual content overlays, logos, and movement. Face and object detection fashions are built-in with AutoFlip by way of MediaPipe, a framework that allows the event of pipelines for processing multimodal knowledge, which makes use of Google’s TensorFlow Lite machine studying framework on processors. This construction permits AutoFlip to be extensible, in keeping with Google, so builders can add detection algorithms for various use instances and video content material.

Google AutoFlip

AutoFlip mechanically chooses a reframing technique — stationary, panning, or monitoring — relying on the best way objects behave in the course of the scene. In stationary mode, the reframed digital camera viewport is mounted ready (like a stationary tripod) the place necessary content material could be seen all through the vast majority of the scene. Panning mode strikes the viewport at a continuing velocity, however, whereas monitoring mode supplies steady and regular monitoring of objects as they transfer round inside the body.

Primarily based on which reframing technique is chosen, AutoFlip determines a cropping window for every body whereas preserving the content material of curiosity. A configuration graph supplies settings for reframing such that if it turns into inconceivable to cowl all of the required area, the system will mechanically change to a much less aggressive technique by making use of a letterbox impact, padding the picture to fill the body. AutoFlip will draw on the background shade (if it’s a stable shade) to make sure the padding blends in, or in any other case use a blurred model of the unique body.

Google AutoFlip

The researchers depart to future work enhancing AutoFlip’s skill to detect “objects related to the intent of the video,” equivalent to speaker detection for interviews or animated face detection on cartoons, and guaranteeing enter video with overlays on the perimeters of the display (equivalent to textual content or logos) aren’t cropped from the view. However they assert that even in its present kind, AutoFlip will “scale back the limitations to … design creativity.”

“By combining textual content/emblem detection and picture inpainting expertise, we hope that future variations of AutoFlip can reposition foreground objects to raised match the brand new side ratios. [And] in conditions the place padding is required, deep uncrop expertise may present improved skill to develop past the unique viewable space,” wrote Frey and Solar. “We’re excited to launch this device on to builders and filmmakers, lowering the limitations to their design creativity and attain by way of the automation of video modifying. The flexibility to adapt any video format to varied side ratios is changing into more and more necessary as the range of units for video content material consumption continues to quickly improve.”

Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

Tech News

Investors in LatAm get bitten by the hotel investment bug as Ayenda raises $8.7 million – TechCrunch

Dinu das



A few of Latin America’s main enterprise capital buyers are actually backing lodge chains.

In reality, Ayenda, the biggest lodge chain in Colombia, has raised $eight.7 million in a brand new spherical of funding, in response to the corporate.

Led by Kaszek Ventures, the spherical will assist the continued enlargement of Ayenda’s chain of motels in Colombia and past. The lodge operator already has 150 motels working underneath its flag in Colombia and has just lately expanded to Peru, in response to a press release.

Financing got here from Kaszek Ventures, and strategic buyers like Irelandia Aviation, Kairos, Altabix, and BWG Ventures.

The corporate, which was based in 2018, now has greater than four,500 rooms underneath its model in Colombia and has develop into the most important lodge chain within the nation.

Investments in brick and mortar chains by enterprise companies are way more widespread in rising markets than they’re in North America. The funding in Ayenda mirrors massive bets that SoftBank Group has made within the Indian lodge chain Oyo and an funding made by Tencent, Sequoia China, Baidu Capital and Goldman Sachs, in LvYue Group late final yr amounting to “several hundred million dollars”, in response to an organization assertion.

“We’re searching for to spend money on firms which can be redefining the large industries and we discovered Ayenda, a staff that’s altering the lodge’s trade in an unprecedented manner for the area”, stated Nicolas Berman, Kaszek Ventures Companion.

Ayenda works with unbiased motels by way of a franchise system to assist them enhance their occupancy and companies. The motels have to use to be a part of the chain and undergo an as much as 30-day inspection course of earlier than they’re accredited to open for enterprise.

“With a broad provide of motels  with one of the best cost-benefit relationship, visitors can journey extra regularly accelerating the financial system”, says Declan Ryan, Managing Companion at Irelandia Aviation.

The corporate hopes to have over 1 million visitors in 2020 of their motels. With rooms itemizing at $20 per-night together with facilities and an across the clock buyer assist staff.

Oyo’s story could also be a cautionary story for firms increasing by way of enterprise funding for lodge chains. The as soon as high-flying firm has been the topic of some scathing criticism. As we wrote:

The New York Times  revealed an in-depth report on Oyo, a tech-enabled finances lodge chain and rising star within the Indian tech group. The NYT wrote that Oyo affords unlicensed rooms and has bribed police officers to discourage hassle, amongst different poisonous practices.

Whether or not Oyo, backed by billions from the SoftBank  Imaginative and prescient Fund, will develop into India’s WeWork is the true trigger for concern. India’s startup ecosystem is more likely to face numerous limitations because it grows to compete with the likes of Silicon Valley.

Continue Reading

Tech News

Best noise-canceling headphones of 2020

Dinu das



For a few years, Bose was the audio gold commonplace for noise-canceling headphones that block out ambient sound and background noise. However different firms have steadily chipped away at Bose’s lead and now it is a aggressive class with loads of compelling noise-canceling choices at totally different costs to purchase. I’ve collected the very best noise-canceling headphones beneath, all of which I’ve absolutely reviewed or used hands-on over a time frame. I will be updating this record as extra audio choices are launched.

Learn extraGreatest true wi-fi earbuds of 2020 | Greatest low-cost wi-fi noise-canceling headphones beneath $100 for 2020 

Juan Garzon / CNET

Sony’s WH-1000XM3, the third era of Sony’s wonderful wi-fi noise-canceling headphones, has a extra comfy match and options even higher sound and music efficiency than its predecessor. Battery life is necessary, and with a robust battery life, it is presently our top-rated audio headphone with noise cancellation, edging out the Bose fashions on some key factors.

Learn our Sony WH-1000XM3 evaluate.

Learn extra: Greatest headphones for working in 2020

Sarah Tew/CNET

Even when the music or audio would not sound as magical as you’d hope a $249 mannequin would, the AirPods Professional nonetheless handle to be an excellent pair of actually wi-fi headphones. That is largely because of their successful design and match, improved bass efficiency (which helps the audio high quality), efficient noise cancellation and wonderful name high quality. Plus, they’re rather a lot much less noticeable than over-ear headphones. Yeah, they’re costly to purchase at $250, however the excellent news is you may use them a lot you may most likely put on the battery down — it does degrade over time and is not replaceable — and have to purchase a brand new pair in 18 to 24 months for those who do not lose them first. 

Learn our Apple AirPods Professional evaluate.

Learn extra: Greatest headphones of 2020  

Sarah Tew/CNET

Bose Noise Cancelling Headphones 700, the long-awaited successor to its QuietComfort 35 II fashions, might not be a quantum leap ahead however they provide barely higher sound, name and noise cancellation high quality. Alas, they value $400 to purchase, however they seem to be a sturdy all-around audio performer with as much as 20 hours of battery life. That is quite a lot of battery life!

Learn our Bose Noise Cancelling Headphones 700 evaluate.

Learn extra: Greatest wi-fi earbuds and headphones for making calls

Sarah Tew/CNET

Whereas they don’t seem to be water resistant, Sony’s new WF-1000XM3 true wi-fi headphones characteristic wonderful sound, are good for listening to music or any audio with, and have one thing you will not discover in Apple’s AirPods: lively noise cancellation. At $230, these noise-canceling earbuds should not low-cost to purchase, however with a battery life lasting as much as 24 hours (much more battery life!) and that good sound, they’re among the many greatest new true wi-fi earbuds of 2020.

Learn our Sony WF-1000XM3 evaluate.

Sarah Tew/CNET

When Jabra first introduced its new Elite 85h ($300, £280 or about AU$435 transformed) over-ear headphones, it touted how it might be outfitted with always-on (hands-free) voice assistant management utilizing Amazon’s Alexa or Google Assistant. Alas, that characteristic did not make it into the ultimate product — apparently it affected battery life an excessive amount of, and battery life is crucial — however the Elite 85h is nonetheless a superb noise canceling headphone that makes music and audio sound good, with good sound high quality, is comfy to put on and likewise works effectively (necessary for over-ear headphones) as a headset for making calls.

Learn our Jabra Elite 85h evaluate.

Sarah Tew/CNET

On the subject of premium noise canceling headphones, Bose and Sony have been the dominant gamers over the previous few years. However now Sennheiser has turned up with its new Momentum 3 Wireless and it deserves some consideration, significantly from of us who’re followers of the Momentum line. It is available for purchase now for $400 (£369) — the identical worth as Bose’s Noise Cancelling Headphones 700.

Not solely does it characteristic improved noise canceling options and wonderful sound and audio, nevertheless it additionally performs effectively as headset for making calls. Whereas its noise cancellation and luxury degree would not fairly measure as much as the noise cancellation and luxury of Sony WH-1000XM3’s, it has properly padded ear cups lined with sheep leather-based and I had no bother rocking it for a two-hour music listening session, to say nothing of the battery life.

Learn CNET first take.

Sarah Tew/CNET

When Bose launched its new flagship Noise Cancelling 700 Headphones it did not drop the QuietComfort 35 II from its headphone line up and it stays a high noise canceling headphone. Whereas I feel the 700 performs higher total, there are individuals who desire the QuietComfort 35 II. It steadily goes on sale for lower than its worth so undoubtedly search for it at a reduction if you wish to purchase it.  

Learn our Bose QuietComfort 35 II evaluate.

David Carnoy/CNET

The Solo Professional is the primary Beats on-ear headphone to characteristic lively noise cancellation and the primary full-size Beats headphone to cost by way of Lightning. It makes use of the corporate’s Pure Adaptive Noise Canceling (Pure ANC), “derived from the over-ear Studio3 Wi-fi, with up to date tuning to accommodate the on-ear kind issue,” Beats says. With a faucet of button, you’ll be able to flip off that noise cancellation to avoid wasting battery life or hit the button a second time to enter an audio transparency mode that means that you can hear the skin world, not simply the music you are listening to.

Accessible in a number of coloration choices, the headphone is supplied with six microphones, two of that are beamforming mics which can be designed to hone in in your voice when making calls or speaking to your voice assistant (Apple’s H1 chip is on board for always-on Siri). The sound is clean and well-balanced with punchy bass that does not make music sound boomy. Fairly comfy for an on-ear mannequin, its extra compact design travels higher than some full-size fashions on this record. I simply want it value rather less.

Learn CNET first take.


Bang & Olufsen’s Beoplay H9 would not get talked about a lot within the dialogue of high noise canceling headphones as a result of at $500, it is a actually dear pair of headphones to purchase. The most recent third-generation model has been upgraded in a number of important ways in which make it higher than the sooner H9i. Battery life for this model has improved over the battery lifetime of the earlier model to 25 hours, there’s now a devoted button in your voice assistant, the padding on the ear cushions and headband is cushier and the contact controls have been tweaked.  The audio sound continues to be good. 

Sarah Tew/CNET

Whereas its noise canceling characteristic and luxury ranges aren’t fairly on par with competing fashions from Bose and Sony, JBL’s Reside 650BTNC ($160) measures up effectively when it comes to sound. These over-ear headphones are price contemplating for those who do not need to spend $300 or extra on a noise canceling headphone. We just like the sound of that!

Learn our JBL Reside 650BTNC evaluate.

Sarah Tew/CNET

Lots of people do not consider the Beats Studio3 Wi-fi as a noise canceling headphone nevertheless it does characteristic lively noise cancellation and spectacular sound. It is somewhat little bit of an underrated headphone, with good battery life, high quality sound and cozy ear pads, and now that it has been out for some time it sells for lower than its record worth and typically considerably much less.

Learn our Beats Studio3 Wi-fi evaluate.

Reality be instructed these are the in-ear headphones I normally take with me on airplane journeys. The noise canceling earbuds take up little or no room in a bag, do not want a battery (so no worrying about battery life) and are good for watching in-flight films, whether or not they be on the airline’s in-flight leisure system or by yourself gadget. They provide surprisingly good noise cancellation. Simply remember your headphone adapter dongle you probably have a cellphone or pill that is lacking the headphone jack. Notice that these in-ear headphones have been out for some time. Since it is a wired mannequin, it is unclear whether or not Bose will replace it, however search for it on sale.   

Learn our Bose QuietComfort 20 evaluate.

Sarah Tew/CNET

If you cannot afford a number of the premium fashions on this record, think about a headphone just like the Sennheiser HD four.50. It affords good sound and an honest noise canceling characteristic in a sexy, comfy design that usually sells for lower than $150. 

Learn our Sennheiser HD four.50 BTNC Wi-fi evaluate.

Good on-ear


Sarah Tew/CNET

On the subject of noise canceling headphones, most individuals go for a full-size mannequin. However for those who’re on the lookout for a set of headphones that is a bit more compact, the AKG N60NC is a superb on-ear headphone that additionally occurs to characteristic lively noise cancellation. 

Learn our AKG N60NC Wi-fi evaluate.

Initially revealed final yr.

Continue Reading

Tech News

The latest Gboard beta is faster, with better support for handwriting

Dinu das



Google’s Gboard is likely one of the greatest Android keyboards on the market. It is also the default keyboard on many telephones, that means you are probably utilizing it in your telephone proper now. And whereas keyboards aren’t the fanciest of apps, they most positively are among the many most necessary, underlying our interactions with virtually each different app.

As a result of we hop out and in of it on a regular basis, it is important to have a keyboard that is performant and would not take ages to load-up. That is why Google, with the newest beta for Gboard (by way of Android Police), goes again to the fundamentals and specializing in bettering start-up instances and lowering keyboard latency, so your enter is registered as quickly as you faucet a key.

Get protected with offers from ExpressVPN, PureVPN, Surfshark & extra

As well as, for individuals who want handwriting as a substitute of typing, Google can also be increasing Gboard’s performance in that regard. With the brand new beta, handwriting enter in English will now help spelling corrections, in addition to next-word predictions, very like the typing keyboard.

Furthermore, whereas Gboard already helps handwriting for a wealth of languages, the corporate is continuous to work on bettering entry to expertise by including Tibetan as one of many supported languages for handwriting.

Google ought to ultimately push the updates to the secure launch however if you would like to get your arms on the brand new options instantly, you’ll be able to go forward and join the Gboard beta here.

Earlier within the month, Google additionally pushed a extra light-hearted replace to the keyboard referred to as ‘Emoji Kitchen’ that permits you to combine and match emoji for some actually hilarious creations. I do not know if a poop emoji with hearts implies love or disgust, however both manner, now you can ship it to your vital different and try to discover out.

Gboard vs. SwiftKey: Which Android keyboard must you use?

Have you ever listened to this week’s Android Central Podcast?

Android Central

Each week, the Android Central Podcast brings you the newest tech information, evaluation and sizzling takes, with acquainted co-hosts and particular friends.

  • Subscribe in Pocket Casts: Audio
  • Subscribe in Spotify: Audio
  • Subscribe in iTunes: Audio

We could earn a fee for purchases utilizing our hyperlinks. Learn more.

Continue Reading


Copyright © 2019