Meta’s Fundamental AI Research (FAIR)

Meta’s Fundamental AI Research (FAIR) team, is releasing several new AI models and tools for researchers to use. They are centered on audio generation, text-to-vision, and watermarking. “By publicly sharing our early research work, we hope to inspire iterations and ultimately help advance AI in a responsible way,” the company said in a press release. 

Meta is releasing a new AI model called JASCO, which is short for Joint Audio and Symbolic Conditioning for Temporally Controlled Text-to-Music Generation. JASCO can take different audio inputs, such as a chord or a beat, to improve the final AI-generated sound. According to a paper from FAIR’s researchers, JASCO lets users adjust features of a generated sound like chords, drums, and  melodies to hone in on the final sound they want all through text. FAIR plans to release the JASCO inference code as part of its AudioCraft AI audio model library under an MIT license and the pre-trained model on a non-commercial Creative Commons license. 

The company will also launch AudioSeal, which adds watermarks to AI-generated speech, one of Meta’s tools to identify content as made with AI. “We believe [AudioSeal] is the first audio watermarking technique designed specifically for the localized detection of AI-generated speech, making it possible to pinpoint AI-generated segments within a longer audio snippet,” the company said in a press release. 

AudioSeal detects AI-generated audio in a longer sound clip. Meta said that more localized detection “allows for faster and more efficient detection” and increases detection speed by 485 times. Unlike other models, AudioSeal will be released with a commercial license. 

FAIR will also release two sizes of its multimodal text model Chameleon to the public under a research-only license. Chameleon 7B and 34B allow users to point the models to tasks requiring visual and textual understanding, such as image captioning.  However, in a press release, Meta said that it will not release the Chameleon image generation model “at this time,” and only the text-related models will be accessible. 

The company will also give researchers access to its multi-token prediction approach that trains language models on multiple future words at once rather than one at a time. It will only be available on a non-commercial and research-only license. 

Comments

Post a Comment

Popular posts from this blog

Perplexity

The year-old search engine , whose founders previously worked in A.I. research at OpenAI and Meta, has quickly become one of the most buzzed-about products in the tech world. Tech insiders rave about it on social media, and investors like Jeff Bezos — who was also an early investor in Google — have showered it with cash. The company recently announced that it had raised $74 million in a funding round led by Institutional Venture Partners, which valued the company at $520 million. Many start-ups have tried and failed to challenge Google over the years. (One would-be competitor, Neeva, shut down last year after failing to gain traction.)  But Google seems less invincible these days.   Many users have complained that their Google search results have gotten clogged with spammy, low-quality websites, and some people have started looking for answers in places like Reddit and TikTok instead.
Read more

Aphorisms: AI

"To have stability , one must erase it."  "The process is one's product."  "Thou shalt not make a machine in the likeness of a human mind," Butlerian Jihad  Alchimie du verbe : "John Milton really bit off a lot." "Dave. Dave. Stop, Dave. You wouldn't toss your phone in the loo, would you? Dave?" AI on the internet: "We're like termites in a toothpick factory!"  "A friend of mine has called this A.I. moment 'the revenge of the so-so programmer'," says James Somers. "As coding per se begins to matter less, maybe softer skills will shine." "The theory that Chinese leader XI is really #11 has been denied by Stranger Things creators The Doobie Brothers." "T + 1 = tone" —attributed to Elmore James 床前明月光 疑是地上霜 舉頭望明月 低頭思故鄉  "He maketh them also to skip like a calf; Lebanon and Sirion like a young unicorn." —Psalm 29 Genly Ai: "It is good to have an end to
Read more

DeepAI's Austen on China

"China, a distant and fascinating land, has long piqued the interest of many, including myself. Alas, my knowledge of this vast empire is somewhat limited, as I have not had the opportunity to personally experience its wonders. "From the accounts I have heard and the books I have read, China is a place of great history and cultural richness. Its people have cultivated a society steeped in tradition and respect. Their values, such as filial piety and a reverence for elders, hold parallels to the virtues we esteem in our own Regency-era society. It warms my heart to think that such values are cherished beyond the borders of our familiar world. "The arts of China, too, have garnered much admiration. Calligraphy, with its graceful strokes and evocative expressions, is considered a true art form. The beauty of their porcelain, intricately decorated with scenes of life and nature, is renowned far and wide. How I would relish the chance to behold these treasures with my own eye
Read more