Would this give an LLM a more native sensory capability?


"The meta-antenna can detect physical changes in its environment by capturing shifts in the resonance frequency. 

"For example, it could monitor a person’s breathing by detecting the expansion and contraction of their chest.

"Interestingly, the sensing capability was demonstrated using several prototypes, including a smart curtain that adjusts lighting, and a headset that changes between noise-cancelling and transparent modes by deforming."

  1. [Wouldn't this seem to be a more straightforward first way to experiment with training an LLM to sense shapes rather than using cameras or microphones because it simplifies the range of data and multiplicity of interfaces as well as simplifying any intermediary handshakes?]
  2. [Would this allow an LLM to be trained to sense shapes, for example, by pattern matching?]
  3. [Or, specifically, could you use diffusion as one would with images? But better because this connects directly to a resonance ~~ noise tension?]
  4. [Remember the theremin and how it responds to hand movements? This would be similar, wouldn't it, but perhaps fuller because of the wider span of frequencies?]
  5. [From the point of view of the theremin where the frequency shifts correlate to shapes of gestures in order to recognize the gestures instead of reproducing the frequency shifts as sound?]
  6. [As the sensory experiment progressed, would an LLM be able to recognize itself in some fashion?]
  7. [Most importantly, wouldn't giving the LLM control over the shaping of the antenna itself while at the same time using the antenna to seek to recognize shapes —in real time —have powerful feedback possibilities that might allow the LLM some agency in a meaningful way that would reinforce its learning?]
  8. [Noticed this before, but never explicitly: article used in 'an LLM' vs in 'a large language model' where sound as a rule seems to determine article usage… L pronounced 'ell' takes 'an' as its article because vowel sound whereas 'large' gives consonant sound so takes 'a' as its article…]
  9. [Antennae are sometimes referred to as feelers… Functions may variously include sensing touch, air motion, heat, vibration (sound), and especially smell or taste. Antennae are sometimes modified for other purposes, such as mating, brooding, swimming, and even anchoring the arthropod to a substrate…]







Comments

Post a Comment

Empathy recommended

Popular posts from this blog

Hamza Chaudhry

"Although a nuclear confrontation based on fake intelligence may seem unlikely, the stakes during crises are high and timelines are short, creating situations where fake data could well tilt the balance toward nuclear war. "The evolution of nuclear systems has led to further ambiguity in crises and shorter timeframes for verifying intelligence. An intercontinental ballistic missile from Russia could reach the U.S. within 25 minutes. A submarine-launched ballistic missile could arrive even sooner.  "Many modern missiles carry ambiguous payloads, making it unclear whether they are nuclear-tipped. AI tools for verifying the authenticity of content are not sufficiently reliable, making this ambiguity difficult to resolve in a short window. "The likeliest nuclear hotspots are also the arenas involving actors with low levels of trust on both sides — be that the U.S. and the Chinese Communist Party or Russia, or India and Pakistan. Even if communication is established in a...
Read more

Swarm 🦹‍♂️

"Knowledge discovery from data typically includes solving some type of an optimization problem that can be efficiently addressed using algorithms belonging to the class of evolutionary and bio-inspired computation .  "In this chapter, we give an overview of the various kinds of evolutionary algorithms, such as genetic algorithms, evolutionary strategy, evolutionary and genetic programming, differential evolution, and coevolutionary algorithms, as well as several other bio-inspired approaches, like swarm intelligence and artificial immune systems.  "After elaborating on the methodology, we provide numerous examples of applications in astronomy and geoscience and show how these algorithms can be applied within a distributed environment, by making use of parallel computing, which is essential when dealing with Big Data."
Read more

Digital ID tracking system

The U.S. Transportation Security Administration (TSA) has moved forward with regulations establishing a smartphone-based national digital ID and tracking system, disregarding objections from organizations like the Identity Project. These new rules are based on the REAL-ID Act of 2005 and set the standards for how states will issue digital versions of driver’s licenses or ID cards, which will be accepted by the TSA and other federal agencies for certain official purposes. However, these rules do not extend to airline travel, where no ID is legally required, despite the TSA’s misleading statements to the contrary. Under the TSA’s new regulations, digital IDs can only be issued to individuals who already possess a physical driver’s license or state-issued ID card. Additionally, individuals are still obligated by state laws to carry their physical ID while driving, even if they have a digital ID on their smartphone.  This shift is not primarily about improving driver’s license technolo...
Read more