Is insurance a rich enough game to disrupt?

For the last decade, the largest technology companies have increasingly looked outside of tech to grow their operations. From automotive to retail to groceries, these companies use massive competitive advantages in the form of data, consumer relationships and software engineers to fundamentally change markets.

Now, companies like Apple and Google and Amazon are eyeing innovation across the insurance landscape. For example, Amazon is teaming with JPMorgan and Berkshire Hathaway to create a new way to approach health insurance, focusing first on the group’s own employees. On the retail side, Amazon is selling product insurance and extended warranties at the point of sale and investing in insurtech startups. Meanwhile, Tesla is developing an insurance product specific to the Model S. Waymo, Uber and Lyft are certainly having similar conversations internally.

Obviously, these are all preliminary steps. Insurance is a complex, multifaceted and, yes, risky business. In the end, whether or not companies like Amazon become insurers themselves depends on their appetite for risk, their ability to innovate and the potential pay off.

To start, let’s look at the reasons why tech giants are well-suited to upend the space.

They have direct consumer relationships

Like many businesses, a large aspect of a successful insurance business is distribution. Just look at brokers, which are a major means of distribution for insurers today — their cut can be up to 30 percent of the cost of an insurance policy. Brokers also see better margins than insurers themselves, usually around 10 percent net margins. Facebook, Amazon, Apple, Microsoft and Google (FAAMG) possess direct relationship with billions of consumers and could, over time, disrupt the broker business.

They have deep data and analytics

The big secret in insurance is that insurers are actually terrible at using their data. Different departments (marketing, underwriting, claims) rarely work together, and their data tends to be siloed. FAAMG, on the other hand, has put data at the core of their offering; they know how to leverage analytics and AI to create better products.

Tech giants may be tempted to use their troves of data to compete with insurers directly.

They also have access to data that insurers can only dream of having: global geospatial imagery of homes, infrastructure and buildings; location, browsing and advertising data; even real-world behavioral data from smartphones and IoT devices. Combining all these signals can create a very complete picture of human behavior, interests and risk profile.

They have an army of software engineers and a monopoly of AI talent

Tech innovation has long been a challenge for insurance incumbents. Old systems are difficult to displace in any industry, but the complexity of insurance, tradition of relying on the past to predict the future and silos of data can make it a Herculean effort. Tech giants, on the other hand, regularly cannibalize their own revenue with new products and can enlist tens of thousands of engineers to develop fantastic digital customer experiences and bring large-scale efficiencies to back-end insurance systems through better software and AI.

So, yes, FAAMG has a number of major advantages over insurance incumbents. But for tech giants, new verticals and initiatives are also longer-term decisions around margins and market scope. It’s an obvious point, but if FAAMG wants to jump into insurance, they’ll want a decent return. Can they find that in insurance?

There are a number of reasons why it might be a tough sell.

Ultra-low margins

Average insurance net margins are 3-8 percent, and 25-30 percent gross margins, which are meager for tech standards. Software companies average around 80 percent gross margins and around 15 percent net margins. Even consumer hardware like the iPhone — a costly endeavor by software standards — sees 55-60 percent gross margins.

Within insurance, health tends to have the highest margins, followed by property and casualty (i.e. home and auto insurance), followed by life insurance. So if anything, healthcare is probably the closest thing to “low-hanging fruit” — but it’s not exactly attractive to most companies outside insurance.

High risk

Such low margin also means that one major event can destroy a company’s balance sheet for an entire fiscal year (think disasters like hurricanes, fire, flood, etc.). In addition, tech companies don’t have the historical data and actuarial scientists that insurers have spent decades building up, so they might be more prone to misjudging their overall risk exposure.

Complex administration

For insurers, evaluating and underwriting policies is an expensive endeavor. Claims, customer support and back-end are costly and complex. That said, most insurance companies are already outsourcing the development of core administration software to companies like GuideWire and Duck Creek, and then customizing the software to meet their specific needs at the last mile. So it’s not as huge of a leap as it once was to think that the likes of Amazon or Google could develop similar infrastructure in-house to rival incumbent systems. Or, they could easily buy one of the development companies outright and subsume that expertise.

Amazon makes a big move

Still, the creation and underwriting of policies is something tech giants have avoided to date. Amazon has been working on warranties for certain products as an add-on to their margins — but these were backed and administered by The Warranty Group rather than Amazon itself. Before that, Amazon acted as a sales channel for SquareTrade and built up an understanding of the warranty business before diving in deeper. Tesla, as another example, announced it was selling Tesla-branded tailor-made policies for its vehicle owners, but those policies were backed by Liberty Mutual.

What role will tech giants in the U.S. play in the insurance landscape?

Then, in January, Amazon made a well-publicized announcement, in tandem with Berkshire Hathaway and JPMorgan, around its intention to create a private healthcare option for their workers. We don’t know much about the initiative, but Amazon has been working on a healthcare technology project codenamed 1492 for some time. Rumors point to a “platform for electronic medical record data, telemedicine, and health apps.” Amazon’s technology paired with Berkshire Hathaway’s insurance knowledge and JPMorgan’s financial expertise makes the creation of a new health insurance entity more likely. If so, this would be a significant shot across the bow of U.S. healthcare insurers.

Of all the tech giants, it would not be a surprise if Amazon were the first to jump into insurance. Amazon has mastered the art of building massive businesses off of razor-thin margins. They’re also targeting health insurance, which presents the best margin opportunity. They can test their offering within the company first and then scale across their massive consumer base. Finally, they have a history of building out complex back-end services for their own purposes before offering it to their customers — just look at AWS.

Will other tech companies follow Amazon’s lead?

Signs point to yes. Recently, Google’s sister company, Verily, “has been in talks with insurers about jointly bidding for contracts that would involve taking on risk for hundreds of thousands of patients.” In addition, Apple will be opening a network of medical clinics for its employees.

It may not stop at health insurance. There’s no question technology is changing human behavior and society, and as the developers of much of this new tech, FAAMG will inevitably be pushed closer to other sectors of insurance, as well, including home and auto.

Autonomous vehicle fleets will make companies like Tesla, Google and Uber the owners of tens of thousands of cars, subjecting them to the risk that comes with that. Meanwhile, IoT hardware and accompanying services are bringing tech giants into the living room. That’s a literal statement when it comes to Amazon Key. Nest, Google Home and Amazon Echo are more innocuous, but provide all sorts of data about what’s going on inside the home and could, someday, help inform the creation of real-time home insurance policies.

East Asia as a leading indicator?

It also can be instructive to look at markets outside the U.S. In East Asia, businesses are taking a more aggressive posture vis-à-vis insurance. BaiduAlibabaRakutenTencent and LINE have all shown some level of appetite for offering their own insurance products. These companies can verify identities, enforce trust and access the behavioral and financial data necessary to provide better policies than many insurance incumbents in those countries.

They also are exploring new ways of looking at risk and changing user behavior: Tencent’s WeSure is paying users to stay healthy by walking more, while Yongqianbao, a lending company, tracks unconventional digital data to determine credit risk, such as phone brand (iPhone users are less likely to default) and whether they let their phone batteries run down.

Still, the question remains: What role will tech giants in the U.S. play in the insurance landscape? Will they act as a channel for existing insurers, as a provider of data and analytics to those insurers or even as a provider of direct insurance themselves?

Insurance may not be lucrative-enough for tech giants in the short-term, but as real-time data and analytics are used to create insurance policies, tech giants may be tempted to use their troves of data to compete with insurers directly. Until then, we can expect insurers and tech giants to form alliances, as they have in East Asia, with tech companies using insurance and warranties as a value-add for their customers, and insurers using tech companies as a sales channel. Regardless, the story of FAAMG (and others) in insurance is undoubtedly just getting started, and we’ll have to check back in as the landscape develops.


Source: Tech Crunch

Samsung’s ‘Galaxy Watch’ trademark fuels speculation about a Wear OS device

Samsung’s got a new smartwatch on the way. That much seems for certain. It’s been about a year since the last big announcement, and the company is about to have two large platforms in the form of August’s Note 9 Unpacked event and Berlin’s IFA trade show the following month.

A couple of new tidbits, however, are fueling speculation that things might be a little different this time around. First, a trademark filing in Korea for a Samsung Galaxy Watch logo. The company dropped the Galaxy bit from its Gear line between the first and second generation watches, back in the 2014.

Among the more notable changes on that device was the move from Android to Tizen, and open-source mobile operating system Samsung has continue to bear the torch for on subsequent watches. The company never really looked back on that decision, even after the arrival of Android Wear.

But 2018 has found Google making a more aggressive push around its wearable operating system. I/O saw some upgrades, following a name change to Wear OS. That, along with a smattering of online rumors, point to Samsung potentially giving Google’s other mobile OS a big go.

It’s hard to make the case that Google has done much to warrant another look at the operating system. The smartwatch category has largely stagnated for everyone but Apple and Fitbit, and the last couple of updates haven’t brought a lot to the table. But perhaps there’s something to be said for increased compatibility across the Galaxy line.

Last year’s Gear Sport found Samsung offering up a more universal piece of hardware than its traditional restrictively large devices, but a ground-up rethink of the line certainly couldn’t hurt.


Source: Tech Crunch

In the public sector, algorithms need a conscience

In a recent MIT Technology Review article, author Virginia Eubanks discusses her book Automating Inequality.  In it, she argues that the poor are the testing ground for new technology that increases inequality— highlighting that when algorithms are used in the process of determining eligibility for/allocation of social services, it creates difficulty for people to get services, while forcing them to deal with an invasive process of personal data collection.

I’ve spoken a lot about the dangers associated with government use of face recognition in law enforcement, yet, this article opened my eyes to the unfair and potentially life threatening  practice of refusing or reducing support services to citizens who may really need them— through determinations based on algorithmic data.

To some extent, we’re used to companies making arbitrary decisions about our lives – mortgages, credit card applications, car loans, etc. Yet, these decisions are based almost entirely on straight forward factors of determination— like credit score, employment, and income. In the case of algorithmic determination in social services, there is bias in the form of outright surveillance in combination with forced PII share imposed upon recipients.

Eubanks gives as an example the Pittsburg County Office of Children, Youth and Families using the Allegheny Family Screening Tool (AFST) to assess the risk of child abuse and neglect through statistical modeling. The use of the tool leads to disproportionate targeting of poor families because the data fed to the algorithms in the tool often comes from public schools, the local housing authority, unemployment services, juvenile probation services, and the county police, to name just a few— basically, the data of low income citizens who typically use these services/interact with them regularly. Conversely, data from private services such as private schools, nannies, and private mental health and drug treatment services — isn’t available.

Determination tools like AFST equate poverty with signs of risk of abuse, which is blatant classism— and a consequence of the dehumanization of data. Irresponsible use of AI in this capacity, like that of its use in law enforcement and government surveillance, has the real potential to ruin lives.

Taylor Owen, in his 2015 article titled “The Violence of Algorithms”, described a demonstration he witnessed by intelligence analytics software company Palantir, and made two major points in response— the first being that oftentimes these systems are written by humans, based on data tagged and entered by humans, and as a result are “chock full of human bias and errors.” He then suggests that these systems are increasingly being used for violence.

“What we are in the process of building is a vast real-time, 3-D representation of the world. A permanent record of us…but where does the meaning in all this data come from?” he asked, establishing an inherent issue in AI and datasets.

Historical data is useful only when it is given meaningful context, which many of these datasets are not given. When we are dealing with financial data like loans and credit cards, determinations, as I mentioned earlier— are based on numbers. While there are surely errors and mistakes made during these processes, being deemed unworthy of credit will likely not lead the police to their door.

However, a system built to predict deviancy, that uses arrest data as a main factor in determination, is not only likely to lead to police involvement — it is intended to do so.

Image courtesy of Getty Images

When we recall modern historical policies which were perfectly legal in their intention to target minority groups, Jim Crow certainly comes to mind. And let’s also not forget that these laws were not declared unconstitutional until 1967, despite the Civil Rights Act of 1965.

In this context you can clearly see that according to the Constitution, Blacks have only been considered full Americans for 51 years. Current algorithmic biases, whether intentional or inherent, are creating a system whereby the poor and minorities are being further criminalized, and marginalized.

Clearly, there is the ethical issue around the responsibility we have as a society to do everything in our power to avoid helping governments get better at killing people, yet the lion’s share of this responsibility lies in the lap of those of us who are actually training the algorithms— and clearly, we should not be putting systems that are incapable of nuance and conscience in the position of informing authority.

In her work, Eubanks has suggested something close to a hippocratic oath for those of us working with algorithms— an intent to do no harm, to stave off bias, to make sure that systems did not become cold, hard oppressors.<

To this end, Joy Buolamwini of MIT,  the founder and leader of the Algorithmic Justice League, has created a pledge to use facial analysis technology responsibly.

The pledge includes commitments like showing value for human life and dignity, which includes refusing to engage in the development of lethal autonomous weapons, and not equipping law enforcement with facial analysis products and services for unwarranted individual targeting.

This pledge is an important first step in the direction of self regulation, which I see as the beginning of a larger grass-roots regulatory process around the use of face recognition.


Source: Tech Crunch

WhatsApp now marks forwarded messages to curb the spread of deadly misinformation

WhatsApp just introduced a new feature designed to help its users identify the origin of information that they receive in the messaging app. For the first time, a forwarded WhatsApp message will include an indicator that marks it as forwarded. It’s a small shift for the messaging platform, but potentially one that could make a big difference in the way people transmit information, especially dubious viral content, over the app.

The newest version of WhatsApp includes the feature, which marks forwarded messages in subtle but still hard to miss italicized text above the content of a message.

The forwarded message designation is meant as a measure to control the spread of viral misinformation in countries like India, where the company has 200 million users. Misinformation spread through the app has been linked to the mob killing of multiple men who were targeted by false rumors accusing them of kidnapping children. Those rumors are believed to have spread through Facebook and WhatsApp.

Last week, India’s Information Technology Ministry issued a warning to WhatsApp specifically:

Instances of lynching of innocent people have been noticed recently because of large number of irresponsible and explosive messages filled with rumours and provocation are being circulated on WhatsApp. The unfortunate killing in many states such as Assam, Maharashtra, Karnataka, Tripura and west Bengals are deeply painful and regretable.

While the Law and order machinery is taking steps to apprehend the culprits, the abuse of platform like WhatsApp for repeated circulation of such provocative content are equally a matter of deep concern. The Ministry of Electronics and Information Technology has taken serious note of these irresponsible messages and their circulation in such platforms. Deep disapproval of such developments has been conveyed to the senior management of the WhatsApp and they have been advised that necessary remedial measures should be taken to prevent  proliferation of  these  fake  and at times motivated/sensational messages. The Government has also directed that spread of such messages should be immediately contained through the application of appropriate technology.

It has also been pointed out that such platform cannot evade accountability and responsibility specially when good technological inventions are abused by some miscreants who resort to provocative messages which lead to spread of violence.

The Government has also conveyed in no uncertain terms that WhatsApp must take immediate action to end this menace and ensure that their platform is not used for such malafide activities.

In a blog post accompanying the new message feature, WhatsApp encouraged its users to stop and think before sharing a forwarded message.


Source: Tech Crunch

SolarWinds acquires real-time threat-monitoring service Trusted Metrics

SolarWinds, the company behind tools like Pingdom, Papertrail, Loggly and a number of other IT management tools, today announced it has acquired Trusted Metrics, a company that helps businesses monitor incoming threats to their networks and servers. This move follows SolarWinds’ acquisition of Loggly earlier this year. Among other things, Loggly also provides a number of security tools for enterprises.

Today’s acquisition of Trusted Metrics is clearly part of the company’s strategy to build out its security portfolio, and SolarWinds is actually rolling Trusted Metrics into a new security product called SolarWinds Threat Monitor. Like Trusted Metrics, SolarWinds Threat Monitor helps businesses protect their networks by automatically detecting suspicious activity and malware.

“When we look at the rapidly changing IT security landscape, the proliferation of mass-marketed malware and the non-discriminatory approach of cybercriminals, we believe that real-time threat monitoring and management shouldn’t be a luxury, but an affordable option for everyone,” said SolarWinds CEO Kevin Thompson in today’s announcement. “The acquisition of Trusted Metrics will allow us to offer a new product in the SolarWinds mold—powerful, easy to use, scalable—that is designed to give businesses the ability to more easily protect IT environments and business operations.”

SolarWinds did not disclose the financial details of the transaction. Trusted Metrics was founded in 2010; although it received some seed funding, it never raised any additional funding rounds after that.


Source: Tech Crunch

New Microsoft Surface hardware is probably arriving tomorrow

Microsoft all but announced as much via the official Surface account. The company tweeted out the leading question “Where will Surface go next?” along with a image of the full lineup — the Pro, Laptop, Book 2 and swiveling all-in-one Studio.

The desktops each displaying 6:00 on Tuesday, July 10 is the other key hint here. The big news will probably drop tomorrow, most likely in the A.M. So, what’s on deck for the Surface line? Given that all of the key players are present and accounted for here, an entirely new entry seems like a pretty reasonable guess.

The rumors of a new, low-end device have been making the rounds for a few months now. Back in May, talk surfaced (😐) of a new, low-cost entry, aimed at competing more directly with the iPad. That certainly makes sense from a Portfolio standpoint. Other rumors include the loss of the proprietary Surface connector, in favor of USB-C and “rounded edges.”

The Surface line has long been focused on creative professionals, which has made most of the entries a bit too steep for casual tablet usage. That Apple has offered up an even cheaper version of the iPad in the wake of a stagnating tablet market, has likely lit even more of a fire under Microsoft.

More info on that front has been popping up over the last couple of weeks, including a supposed spec sheet and a launch date of this Friday, coupled with a recent appearance at the FCC.


Source: Tech Crunch

Instacart hires its first chief communications officer, Dani Dudeck

Instacart, the grocery delivery platform valued at $4.2 billion, has today announced that it has hired its first chief communications officer in Dani Dudeck.

Dudeck has been in the communications world for the past 15 years, serving as VP of Global Communications at MySpace for four years and moving to Zynga as CCO in 2010. At Zynga, Dudeck oversaw corporate and consumer reputation of the brand before and after its IPO, helping the company through both tremendous periods of growth and a rapidly changing mobile gaming landscape.

Dudeck joins Instacart at an equally interesting time for the company. Though Instacart is showing no signs of slowing down — the company recently raised $200 million in funding &mdash; the industry as a whole is seeing growing interest from incumbents and behemoth tech companies alike.

Amazon last year acquired Whole Foods for nearly $14 billion, signaling the e-commerce giant’s intention to get into the grocery business. Plus, Target acquired Shipt for $550 million in December. Meanwhile, Walmart has partnered with DoorDash and Postmates for grocery delivery after a short-lived partnership with Uber and Lyft.

In other words, the industry is at a tipping point. Instacart not only needs to out-maneuver the increasingly competitive space, but continue to tell its story to both consumers and potential shoppers/employees alike.

Dudeck plans to hit the ground running after having been an Instacart customer since 2013.

Here’s what Dudeck had to say in a prepared statement:

We’ve been an Instacart family for years and as a mom it’s been a game changer for me. Our home is powered by Instacart because over the years, I saw how the products helped me better manage our household rhythm. Whether I’m doing a fast diaper delivery or fresh groceries for our weekly shopping, I love feeling like I can be in two places at once while getting to spend more time with my family. After getting to know the internal team, I was blown away by the strength of Instacart’s business and the unique culture they’ve created. By building on that success, we have a compelling opportunity to grow Instacart into a beloved, household name and turn Express into a must-have membership for families and busy people everywhere. I’m excited to join the management team and partner with them to accelerate their ambitious plans for future growth.


Source: Tech Crunch

Meet TechCrunch in Tunis, Cairo, Dubai and Beirut this month

TechCrunch just announced our first-ever Startup Battlefield MENA taking place in Beirut, Lebanon in October. We’re hitting the road to meet with regional early-stage startups, investors and entrepreneurs in July. Sign up below.

Startups and investors can meet the TechCrunch team and learn more about TechCrunch’s Startup Battlefield program. Founders will learn how to apply for Startup Battlefield with a solid application, and investors will learn how to refer early-stage companies in their portfolio.

We’ll be visiting Tunis, Cairo, Dubai and Beirut to meet with founders, investors, angels and established entrepreneurs across the Middle East and North Africa.

Startup Battlefield is TechCrunch’s renowned startup launch competition. The Startup Battlefield alumni community comprises almost 765 companies that have raised more than $8 billion USD and produced over 105 successful exits and IPOs.

Applications are now open, and founders can apply here until July 31. You can also refer founders here and speakers or judges here.

For questions, please email battlefield@techcrunch.com

Hold the dates in your calendar below, and sign up here to get updates as RSVP links go live.

2018 TechCrunch MENA Meet and Greets

Tunis, Tunisia

July 12th, Thursday
Host: Cogite
Time: 6:30pm to 8:30pm
RSVP

Cairo, Egypt

July 17th, Tuesday
Host: TBD
Time: TBD
RSVP COMING SOON

July 18th, Wednesday
Host: TBD
Time: TBD
RSVP COMING SOON

Dubai, UAE 

July 24th, Tuesday
Host: TBD
Time: TBD
RSVP COMING SOON

Beirut, Lebanon 

July 26th, Thursday
Host: TBD
Time: TBD

RSVP COMING SOON


Source: Tech Crunch

TrustToken opens its dollar-backed cryptocurrency to accredited investors

Pitching a dollar-pegged token that offers cryptocurrency speculators a way to move their investments across volatile exchanges, TrustToken (the first public investment from a16z crypto) is now looking for public investments from accredited investors on CoinList.

The company’s first token is TrueUSD, a stablecoin that is redeemable one-to-one for U.S. dollars. In its first four months of trading, the speculative investors that are looking for some sort of island of security have boosted the coin’s market price to more than $85 million.

There’s a $61 million hard cap on the token allocated over three tranches at $0.12, $0.14 and $0.16 per trust token.

Other investors in TrustToken’s initial $20 million pre-sale include BlockTower Capital, Danhua Capital, GGV Capital, Jump Capital and other undisclosed investors.

As it expands its investor base to include accredited investors, the TrueUSD currency is also expanding its reach, with an agreement between the company and HitBTC to list the stablecoin as a quote currency. The TrueUSD coin can be used as a stalking horse to secure investments in Ethereum, Bitcoin, Tether, Bitcoin Cash, Litecoin, Monero, 0x and NEO, according to a statement from the company.

Every TrueUSD token is redeemable one-for-one with U.S. dollars, which the company’s founders think should open the door for more institutional investment (or speculation depending on your point of view) into the market.

Using TrueUSD’s system, dollars are held in the escrow accounts of multiple trust companies rather than in a bank account. Those accounts are verified by an independent third party that issues monthly reports on the amount of dollars held in collateral.

A buyer of TrueUSD needs to pass a know your customer and AML check and then can send dollars to one of TrueUSD’s trust company partners. Once that transaction is verified, the TrueUSD smart contract issues tokens on a one-to-one ratio before sending the tokens to a buyer. The company uses Prime Trust, a Las Vegas-based company for its financial services.

Once tokens are delivered to a wallet, those tokens can be transferred or used as payment to buy other cryptocurrencies.

“The users of this space are really the traders,” says TrustToken co-founder and chief executive Danny An. “They want a native crypto asset that’s stable. They want to be able to hedge against volatility.”

An said the company does have a broader vision than just helping traders secure speculative assets so they can come up with even more arcane financial instruments. “For the entire crypto-economy to work, a lot of people believe that a stablecoin or multiple stablecoins need to be created,” An said.

TrustToken makes money whenever its coins are minted or burned, An says. “Whenever USD is involved we take a small cut,” which is 10 basis points per transaction, he said.

Ultimately, TrustToken (like other alt-coins) wants to tokenize all real-world assets. And one of the most attractive markets for An and his co-founders is real estate. “There is $200 trillion dollars of real estate that is offline,” said An. Tokenizing those assets would create more wealth in the world overall, he said. “Assets that are not liquid are not as valuable as assets that are liquid,” An said.

It’s a far cry from the work that An and his co-founders Rafael Cosman and Stephen Kade were doing at Kernel — a company that was developing technologies to create neural interfaces between humans and machines.

“The problem with Kernel or Google Brain [where the team also spent time] was that the timelines were very long,” An said. 


Source: Tech Crunch

Snapchat code reveals team-up with Amazon for ‘Camera Search’

Snapchat is building a visual product search feature, codenamed “Eagle,” that delivers users to Amazon’s listings. Buried inside the code of Snapchat’s Android app is an unreleased “Visual Search” feature where you “Press and hold to identify an object, song, barcode, and more! This works by sending data to Amazon, Shazam, and other partners.” Once an object or barcode has been scanned you can “See all results at Amazon.”

Visual product search could make Snapchat’s camera a more general purpose tool for seeing and navigating the world, rather than just a social media maker. It could differentiate Snapchat from Instagram, whose clone of Snapchat Stories now has more than twice the users and a six times faster gro

wth rate than the original. And if Snapchat has worked out an affiliate referrals deal with Amazon, it could open a new revenue stream. That’s something Snap Inc. direly needs after posting a $385 million loss last quarter and missing revenue estimates by $14 million.

TechCrunch was tipped off to the hidden Snapchat code by app researcher Ishan Agarwal. His tips have previously led to TechCrunch scoops about Instagram’s video calling, soundtracks, Focus portrait mode and QR Nametags features that were all later officially launched. Amazon didn’t respond to a press inquiry before publishing time, and it’s unclear if its actively involved in the development of Snapchat visual search or just a destination for its results. Snap already sells its Spetacles v2 camera glasses on Amazon — the only place beyond its own site. Snap Inc. gave TechCrunch a “no comment,” about visual search but the company’s code tells the story.

Snapchat first dabbled in understanding the world around you with its Shazam integration back in 2016 that lets you tap and hold to identify a song playing nearby, check it out on Shazam, send it to a friend or follow the artist on Snapchat. Project Eagle builds on this audio search feature to offer visual search through a similar interface and set of partnerships. The ability to identify purchaseable objects or scan barcodes could turn Snapchat, which some view as a teen toy, into more of a utility.

What’s inside Snapchat’s Eagle eye

Snapchat’s code doesn’t explain exactly how the Project Eagle feature will work, but in the newest version of Snapchat it was renamed as “Camera Search.” If you remember, Snap used another animal name, “Cheetah”, as the secret word for its big redesign. The app’s code lists the ability to surface “sellers” and “reviews,” “Copy URL” of a product and “Share” or “Send Product” to friends — likely via Snap messages or Snapchat Stories. In characteristic cool kid teenspeak, an error message for “product not found” reads “Bummer, we didn’t catch that!”

Eagle’s visual search may be connected to Snapchat’s “context cards,” which debuted late last year and pull up business contact info, restaurant reservations, movie tickets, Ubers or Lyfts and more. Surfacing within Snapchat a context card of details about ownable objects might be the first step to getting users to buy them… and advertisers to pay Snap to promote them. It’s easy to imagine context cards being accessible for products tagged in Snap Ads as well as scanned through visual search. And Snap already has in-app shopping.

Snapchat’s Camera Search could become a direct competitor for Pinterest’s Lens, which identifies objects and brings up related content. Pinterest has evolved the product, embedding it inside the apps of retailers like Target. Beyond shopping, Camera Search could let Snapchat users find Stories that contain the same object they’re snapping.

Being able to recognize what you’re seeing makes Snapchat more fun, but it’s also a new way of navigating reality. In mid-2017 Snapchat launched World Lenses that map the surfaces of your surroundings so you can place 3D animated objects like its Dancing Hotdog mascot alongside real people in real places. Snapchat also released a machine vision-powered search feature last year that compiles Stories of user-submitted Snaps featuring your chosen keyword, like videos with “puppies” or “fireworks,” even if the captions don’t mention them.

Pinterest’s Lens visual search feature

Snapchat was so interested in visual search that this year, it reportedly held early-stage acquisition talks with machine vision startup Blippar. The talks fell through with the U.K. augmented reality company that has raised at least $99 million for its own visual search feature, but which recently began to implode due to low usage and financing trouble. Snap Inc. might have been hoping to jumpstart its Camera Search efforts.

Snap calls itself a camera company, after all. But with the weak sales of its mediocre v1 Spectacles, the well-reviewed v2 failing to break into the cultural zeitgeist and no other hardware products on the market, Snap may need to redefine what exactly that tag line means. Visual search could frame Snapchat as more of a sensor than just a camera. With its popular use for rapid-fire selfie messaging, it’s already the lens through which some teens see the world. Soon, Snap could be ready to train its eagle eye on purchases, not just faces.

In related Snapchat news:


Source: Tech Crunch