• Front Research
  • Posts
  • Apple's Ferret-UI Poised to Boost Siri's iOS App Understanding

Apple's Ferret-UI Poised to Boost Siri's iOS App Understanding

+ 10 more breaking tech news.

Presented by


Apple's visionOS is gaining traction among business users, thanks to its capabilities for mission-focused applications. Apple has announced new developer support via the Enterprise Spatial Design Lab, while Deloitte is expanding its Apple practice with an Academy for Apple Vision Pro. Leaders in tech see opportunities with the new wearable computing interfaces which use AI to unlock productivity. Vision OS has drawn interest from various sectors, with notable developments from SAP, Microsoft, Porsche, and KLM Royal Dutch Airlines. Additionally, a vast assortment of enterprise-focused apps continue to surface.

YouTube is introducing new shopping features, enabling creators to curate shoppable collections and optimize monetization of their videos. The announcement comes as TikTok Shop vies for a bigger share of the U.S. market, aiming to expand its business to $17.5 billion this year. YouTube's latest additions also include an Affiliate Hub to facilitate access to shopping partners and commission information, along with Fourthwall, a website builder, to its integrated platforms.

Apple's Ferret LLM has the potential to enable Siri to understand the layout of iOS apps. The project was revealed in a paper by Cornell and Apple researchers, who described a novel multimodal large language model (MLLM), Ferret-UI. This development could improve Siri's actions in apps by comprehending user interface elements. It holds potential not just for enhanced device control but can also benefit visually impaired users through detailed on-screen explanations and task execution on command.

Facing increased legal scrutiny, AI company OpenAI is bolstering its legal team to handle disputes, including copyright infringement allegations by author Sarah Silverman and others. The company also faces lawsuits from Elon Musk and several investigations from US and European agencies over alleged competition, securities, and consumer protection law violations. OpenAI's legal challenges extend beyond regulatory probes to include lawsuits over its perceived detour from its original nonprofit mission.

Rubrik has filed its initial S-1 statement, providing information for potential investors before its shares are listed on a stock exchange. The data-centric firm offers a cybersecurity platform built on Zero Trust principles to protect businesses against cyberattacks. It reported $628 million in revenue over the past year with a 77% gross margin. The document forecasts the firm's total addressable market will reach $36.3 billion by the end of 2024, growing to $52.9 billion by 2027.

The proposed Generative AI Copyright Disclosure Act could require AI companies to file copyrighted works in their training datasets to the Register of Copyrights ahead of releasing new AI systems. Introduced by Congressman Adam Schiff, the bill aims to clarify how AI firms use copyrighted material. Companies like OpenAI might face litigation and financial penalties under this act, despite claiming fair use of copyrighted content.

Google has introduced its first custom Arm-based CPUs, the Axion processors, for data centers, with claims of 30% better performance and 50% more energy efficiency than other current instances. The Axion CPUs are expected to launch later this year.

OpenAI has upgraded its GPT-4 Turbo model to better analyze text and images. The model can now generate conclusions with a singular API call, providing full vision request support, easing integration into applications, and streamlining developer workflows. This enhancement will fortify use cases such as coding based on interface drawings.

Intel has unveiled its new Gaudi 3 AI accelerator, claiming better performance and efficiency than Nvidia's H100 for less money. The Gaudi 3, part of Intel's broad AI enablement programs, is set for high-volume production in Q3 2024.

TikTok plans to launch TikTok Notes, a new photo-sharing app set to compete with Instagram. It will feature " existing and future public TikTok photo posts", with an option to opt-out. Users can add captions to photos on the platform.

eBay's iOS app now has an AI-powered ""shop the look"" feature providing personalized fashion recommendations. Initially available in the U.S. and U.K., Android support will follow later this year.

Get A Tailor-Made Newsletter for Your Company

Want to help your executive team and employees stay on top of competitors, trends, and the market?

With our Monitor service, we create a newsletter that perfectly fits your interests and needs and send it daily to your employees. Think of it like the regular Tech Brief, but custom-made for your company’s interests.

14-day money-back guarantee, let’s start a discussion today!

Get in touch now.

Join the conversation

or to participate.