Cognitive AI
Cognitive AI
  • 8
  • 110 227
Generalist AI beyond Deep Learning
Generative AI represents a big breakthrough towards models that can make sense of the world by dreaming up visual, textual and conceptual representations, and are becoming increasingly generalist. While these AI systems are currently based on scaling up deep learning algorithms with massive amounts of data and compute, biological systems seem to be able to make sense of the world using far less resources. This phenomenon of efficient intelligent self-organization still eludes AI research, creating an exciting new frontier for the next wave of developments in the field. Our panelists will explore the potential of incorporating principles of intelligent self-organization from biology and cybernetics into technical systems as a way to move closer to general intelligence. Join in on this exciting discussion about the future of AI and how we can move beyond traditional approaches like deep learning!
This event is hosted and sponsored by Intel Labs as part of the Cognitive AI series.
Переглядів: 64 075

Відео

Multiway Systems as Models to Understand Mind and Universe - a Conversation with Stephen Wolfram
Переглядів 21 тис.2 роки тому
Our earliest models of reality were expressed as static structures and geometry, until mathematicians of the 16th century came up with differential algebra, a framework which allowed us to capture aspects of the world as a dynamical system. The 20th century introduced the concept of computation, and we began to model the world through state transitions. Stephen Wolfram suggests that we may be a...
VL-InterpreT: An Interactive Visualization Tool for Interpreting Vision-Language Transformers
Переглядів 2,1 тис.2 роки тому
VL-InterpreT was accepted to CVPR 2022. Paper: arxiv.org/abs/2203.17247 Demo: vlinterpretenv4env-env.eba-vmhhefup.us-east-2.elasticbeanstalk.com/ VL-InterpreT provides novel interactive visualizations for interpreting the attention and hidden representations in multimodal transformers. It is a task agnostic and integrated tool that (1) tracks a variety of statistics in attention heads throughou...
Vectors of Cognitive AI: Self-Organization
Переглядів 8 тис.2 роки тому
Panelists: Prof. Christoph von der Malsburg, Prof. György Buzsáki, Prof. Dave Ackley, Dr. Joscha Bach. Biological and social agents are very different from our present approaches to technologically designed artificial agents. Technological systems are constructed “from outside in”: they extend a world with known, reliable functionality by forging a deterministic substrate into additional, requi...
Vectors of Cognitive AI: Attention
Переглядів 8 тис.2 роки тому
Panelists: Michael Graziano, Jonathan Cohen, Vasudev Lal, Joscha Bach The seminal contribution "Attention is all you need" (Vasvani et al. 2017), which introduced the Transformer algorithm, triggered a small revolution in machine learning. Unlike convolutional neural networks, which construct each feature out of a fixed neighborhood of signals, Transformers learn which data a feature on the nex...
Vectors of Cognitive AI: Motivation and Autonomy
Переглядів 3,4 тис.2 роки тому
How can we conceptualize and construct artificial agents with rich autonomy? How can we use computational models to understand the agency of humans, and shape the collaboration between human and AI agents? Our panel brings a group of thinkers about artificial agency, motivation, emotion and sociality together, to discuss how intrinsic motivation gives rise to goal directed behavior, the organiz...
Panel on Representational Paradigms for Cognitive AI
Переглядів 3,2 тис.2 роки тому
There is a wide gap between current machine learning representations and the way in which our minds represent reality. Our mental representations are dynamic, coherent, unified (in the sense that we establish relationships between all our domains of knowledge, in the context of a global universe), and they are updated on the fly. In this panel, we bring some important thinkers and practitioners...
Knowledge Injection in Neural Networks: Panel Discussion
Переглядів 7662 роки тому
Gadi Singer, VP at Intel Labs, sits down with leading AI researchers and thought leaders: Gary Marcus, Luis Lamb, Vered Shwartz, Partha Talukdar. Watch as they discuss how injection of knowledge and neuro-symbolic methods can mitigate some of the drawbacks of neural networks.

КОМЕНТАРІ

  • @SB324
    @SB324 27 днів тому

    Keep going we are supporting you!

  • @Telencephelon
    @Telencephelon 28 днів тому

    I think Joscha gave it his best but then again Wolfram is about Wolfram and not about the ground-truth

  • @Subject18
    @Subject18 Місяць тому

    I love this video! I'm so glad that Joscha & Wolfram had a recorded dialogue!

  • @youtubebane7036
    @youtubebane7036 4 місяці тому

    Remember perceiving is this the opposite polarity of conceiving

  • @youtubebane7036
    @youtubebane7036 4 місяці тому

    Everything is literally a measuring device

  • @youtubebane7036
    @youtubebane7036 4 місяці тому

    That's why everyone thinks of Consciousness as movement skill that realm of information that is not exactly complete Stillness and that is what mind is and that's what's infinite

  • @youtubebane7036
    @youtubebane7036 4 місяці тому

    When you speak of a Continuum you have to speak of infinity because that's what it is or at least potentially so because the universe will never stop expanding contrary to popular belief and one of these days the blank spaces will be as big as this universe is and they will all contain their own universities within them that have their own spaces destined to become the universe

  • @youtubebane7036
    @youtubebane7036 4 місяці тому

    There's a Continuum end a discreet thing picture must be because that is the two different sides of the duality

  • @youtubebane7036
    @youtubebane7036 4 місяці тому

    It is the information that creates locations in a roundabout fashion at least because it is information manifesting itself as Consciousness creating moments in time that we know of is the present or now these locations in the temporal dimension of our universe that gives rise to locations in the spatial dimensions which give rights to all manner of other growth of infinity like Multiplicity add magnitude. All Infinities melt into all others

  • @youtubebane7036
    @youtubebane7036 4 місяці тому

    Pompous i might but I've been thinking about this non-deterministic turing machine that yaska is talking about for a few years now and I call it the singularity or the point of paradox point where the present moment of now is occurring or the point where all opposites are I brought back together where nothingness and Infinity Touch. All of reality is a pattern

  • @youtubebane7036
    @youtubebane7036 4 місяці тому

    The reason anything existed at all is because it has to because information. What would describe what nothingness is except information? Isn't that something? So it is the default. But what is information and where did the information come from? Is it information a language? What could speak such a language?

  • @nantucketcannabis
    @nantucketcannabis 4 місяці тому

    We need a discussion between Wolfram, Levin, and Friston

  • @philosopherkink
    @philosopherkink 4 місяці тому

    Came for Joscha Bach, stayed for Dave Ackley

  • @markkeeper7771
    @markkeeper7771 5 місяців тому

    🎯 Key Takeaways for quick navigation: - Introduction to the event featuring guest speakers Christoph Van Der malsberg and Michael Levin, hosted by Dr. Joshabach. 01:23 🤔 Questioning the Limits of Deep Learning - Exploring whether deep learning can overcome its current limitations through scaling, codecs, and online learning. - Explanation of differentiable computing in deep learning. - Discussing the equivalence of continuous and discrete mathematics in computation. 14:10 ⚙️ Exploring Automata as an Alternative - Suggesting that learning through self-play with discrete systems may be equivalent to deep learning. 18:06 🌌 Non-Deterministic Turing Machines - Speculating on how the brain's parallelism and stochasticity could be implemented using a non-deterministic Turing machine model. - Noting that current biological models often fall short in replicating the functionality seen in digital models. - Questioning whether current theoretical tools in neuroscience are functionalist enough to understand the information processing in nervous systems. 23:36 🧠 Neuron as Reinforcement Learning Agent - Implementing adaptive functions, neurons aim to survive in the brain by reaping rewards based on their actions. - Neurons are not only specialized switches; any cell can process information in multicellular organisms. - The possibilities of evolution and the capabilities of individual cells suggest that every multicellular organism operates as a slow brain. 28:25 🤔 Consciousness and Self-Reflexive Attention - Consciousness may not be as rare as thought; self-reflexive attention could be crucial for learning beyond mere pattern recognition. - The role of consciousness in learning goes beyond simple sensory input; it contributes to creating a coherent model of reality. - Brain organization may not be hard-coded but evolves through neural Darwinism. - The brain's organizational structure is shaped through evolution and competition between different forms of organization. - Gary Edelman's idea of neural Darwinism suggests that the genome provides conditions for starting evolutionary processes, leading to diverse brain organizations. - Transitioning from image-based learning to video-based learning provides information preservation and constraint-based learning. - The brain's approach to learning and using computational primitives differs from the challenges faced by neural networks in training. 37:25 💰 Reward-Driven Language in the Brain - The reward system in the brain is similar to an economic problem faced by a corporation. - Unlike market-based rewards, every neuron consumes similar resources, emphasizing a unique reward-driven language in the brain. 43:14 🤖 New Paradigm: Selector and Modifier Functions - Neurons can be densely arranged in a lattice, allowing them to self-organize and adapt through global functions. - The selector and modifier function paradigm offers a potential alternative to traditional deep learning, inspired by biological principles. 46:49 🧠 Rethinking Human Identity and Intelligence: - Humans are often seen as discrete natural kinds, but considering developmental biology and evolution, there are no sharp lines between species. - Developmental changes occur gradually, challenging the idea of discrete intelligence, especially during metamorphosis as seen in caterpillars transforming into butterflies. 53:59 🌐 Collective Intelligence in Biological Systems: - All biological systems, including humans, exhibit collective intelligence, working as unified entities made up of intelligent components. - The scaling interface is crucial for individual subunits to collaborate and present a coherent agent to the environment. 57:43 🧪 Competence of Single Cells in Problem Solving: - Single cells, like amoeba and slime molds, demonstrate competence in problem-solving, even without a nervous system. - Recognizing intelligence beyond three-dimensional space is crucial, understanding physiological, morphological, and pattern-based problem-solving. 01:00:18 🧬 Problem-Solving in Genetic Space: 01:02:56 🧠 Intelligence in Development and Regeneration: - Picasso tadpoles and regenerating salamanders reveal intelligence in recognizing unexpected changes and taking corrective action. 01:06:28 🔄 Full Stack Models for Understanding Intelligence: - Recognizing parallels between biology and computer science, where algorithms guide functional activities at different levels. - Bioelectrics: Study of how all cells use electrical signaling to form computational networks. 01:08:19 🧲 Bioelectricity in Collective Intelligence and Counterfactual Memories - Collective Intelligence: Treating groups of cells as collective intelligence solving anatomical problems. - Counterfactual Memories: Cells exhibit counterfactual memory, representing future states based on injury likelihood. - Bioelectricity in Memory: Reading and writing memories in collective intelligence using bioelectric signals. - Cells in Conflict: Cells in conflict with the environment when disconnected, akin to cancer behavior. 01:13:39 🧠 Connecting Homeostats to Form Larger Networks - Computational Goal States: Exploring how a single body can store multiple computational goal states. 01:14:46 🤖 Emergence of Xenobots: Novelty, Behavior, and Self-Replication - Kinematic Self-Replication: Demonstration of self-replication in the absence of transgenes or nanomaterials. - Parts with Agendas: Importance of individual parts having agendas in a living system. 01:24:21 🌌 Open-Ended Evolution and Ethical Implications - Potential for New Beings: Cyborgs, biobots, and hybrids present a vast array of possibilities in the biosphere. - Ethical Considerations: Implications for ethics in dealing with new forms of life and intelligence. - Current methods of assessing AI intelligence based on evolutionary origins are inadequate. - Connectivity patterns and self-interaction play a crucial role in shaping brain activity. 01:32:01 🧠 Perspective Shift: Neurons and Firing Environment - Proposes a shift in perspective from individual neurons to the firing environment. - Compares a single pixel on a screen to a single neuron, highlighting the importance of context in understanding neural activity. - Challenges the notion of infinite possibilities in intelligent and organized patterns. - Discusses the recurring convergence of certain biological patterns across different species. 01:37:46 🤖 AI's Lack of Behavioral Goals - Questions the true intelligence of AI systems that don't align their actions with recognizable goals. - Defines consciousness as the concentration of the entire brain on a single topic. - Discusses the continuity of consciousness across evolution, diminishing in volume. - Challenges the idea of a clear point where consciousness disappears in the evolutionary ladder. - Addresses the necessity of communication protocols for different types of intelligence. - Questions whether human vulnerability to cancer is linked to a lack of intelligence at the local organismic level. - Questions on the internal competency of cells or neurons in driving intelligence. - Joshua raises concerns about creating long-lived, coherent organisms and the formalization of multi-scale organization. 01:55:38 🌍 Humans in the Grand Scheme of Life on Earth - Discussing the hierarchical organization beyond individual humans. - Examining how humans, as specific entities, fit into the broader context of life on Earth. 01:57:53 🤔 Coherence and Stability in Biological Forms - Drawing parallels between the stability of coherent forms and mathematical singular points. - Questioning the information complexity of the genome and the inherent complexity of cell machinery. - Speculating on the complexity of the information needed for self-replication in cells. - Proposing a system with arrays of modules for different modalities and dynamic projection patterns. - Addressing challenges in self-driving cars, including reliance on classifiers and rule-based behavior. - Discussing the public perception of self-driving cars and media biases. 02:11:23 🧠 GPT-3 and the Need for Coherence - Acknowledging the achievements of GPT-3 and its impressive capabilities. - Highlighting the system's lack of insight into real-world representations and geometric understanding. - Discussing the importance of interaction and the need for improved data structures in representing themes and realities. - The difficulty of filling a high-dimensional space with examples due to its vastness. - Objects conceptualized as chunks, composed of features defining their nature. 02:19:01 ⚙️ Activation Traces and Neural Network Processing - Activation traces in neural networks modulate patterns based on content. - Distributed computational pipeline in neural networks. - Debate on components and dynamic mappings in neural networks. - Matthew Cook's perspective on slips of paper as components for cognitive tasks. - The importance of variables as the "glue" to connect abstract forms with concrete elements. - Variables as essential elements for abstract representation. - Describing arbitrary scripts using lateral and compositional links. 02:24:37 🧠 Perspectives on Intelligence - Three perspectives on intelligence: convergence, hierarchical pattern matching, and construction. - Convergence as seen in deep learning, modifying functions through gradient descent. - Hierarchical pattern matching using evolved operators for efficient activation pattern matching. Made with HARPA AI

  • @omridrori3286
    @omridrori3286 6 місяців тому

    not work anynore

  • @RyanDavisSoftware
    @RyanDavisSoftware 6 місяців тому

    I HAVE BEEN WAITING FOR THIS!!! I literally feel like I've witnessed a miracle

  • @krzysztofwos1856
    @krzysztofwos1856 6 місяців тому

    Joscha Bach strikes me as one hop, skip, and a jump from being an Arahant. I can't think of anybody with a deeper understanding of the philosophical issues around computation. Stephen Wolfram's systematic investigation of what computation is like is the close second, but I don't think Stephen has computed (pun totally intended) the consequences of his theories as deeply as Joscha has. I feel very privileged that I have access to such wonderful minds as Joscha, Michael, and Christoph. What a fascinating conversation!

  • @krzysztofwos1856
    @krzysztofwos1856 6 місяців тому

    I believe that C. elegans connectome has now been booted up in a computer.

  • @truthlivingetc88
    @truthlivingetc88 7 місяців тому

    The looks of restless bemusement mixed with exhausted admiration start to kick in a bit around about 4100 as the other two guys` body languages begin to communicate the beginnings of (affectionate) exasperation.

  • @Telencephelon
    @Telencephelon 8 місяців тому

    This was great.

  • @Vishal-ih3tc
    @Vishal-ih3tc 8 місяців тому

    1:19:00

  • @starblue324
    @starblue324 8 місяців тому

    Joscha Bach is worth the existential crises I went through to find him

  • @teemukupiainen3684
    @teemukupiainen3684 9 місяців тому

    Like Mozart and Beethoven meeting and playing duos together. Than you so much. 🎻🎻🎻

  • @buzzbear
    @buzzbear 10 місяців тому

    It seems to me that cellular entities need to have a sense of some kind of ethics in order to form multi-cellular entities. The ability to predict that a desired outcome can be obtained in a society rather than as an individual. Could it be possible that this information is encoded in the genome if the cell or is this a fundamental property of existence? A singular cell also contains parts that need to corporate.

  • @buzzbear
    @buzzbear 10 місяців тому

    I am curious, are cellular automatons equivalent to nondeterministic Turing machines, if each cell including newly created ones compute states in parallel? Thank you so much for this presentation please keep sharing your knowledge.

  • @yifuxero5408
    @yifuxero5408 11 місяців тому

    Wolfram vs Bach on the Continuum. Bach argues wrongly against it saying that we observe at any vertex in Wolfram's Ruliad is only a collection of discrete things. (This is bad logic akin to Zeno's Paradox that the trajectory covered by an arrow will never get you there since the distance of 1 is composed of the parts 1/2 + 1/4 + 1/8..(distance cut in half at each step)).. Obviously, Zeno meant this as a joke. There IS in fact an ABSOLUTE Continuum, what Aristotle called "Being-In-Itself", the Ousia of the Stoics, the "One" of Plotinus, the Tao, the Ein Sof of the Zohar, the Sat-Chit-Ananda of Shankara, and the Rigpa of Buddhism. This is experiential but not in a dualistic sense. Access "Mahamritunjaya Mantra - Sacred Sounds Choir" and listen to it for 5 min per day for at least two weeks. In due time your mind will transcend itself (demolishing the idea of a separate observer), and AHA, what's left is Pure Consciousness, In-Itself, the Absolute Continuum.

  • @teemukupiainen3684
    @teemukupiainen3684 11 місяців тому

    What a great joke they finnished the conversation! Or was it a joke?

  • @michaelwalsh9920
    @michaelwalsh9920 11 місяців тому

    “I know the only conscious being in the world is myself” this is an epic conclusion to an epic conversation between three human geniuses. Thank you!

  • @Gattomorto12
    @Gattomorto12 Рік тому

    1

  • @Gattomorto12
    @Gattomorto12 Рік тому

    2

  • @abdulshabazz8597
    @abdulshabazz8597 Рік тому

    Perhaps there has to be an encoded binary relationship between cells in the way (the roots of) plants seek water. Then the eye cells collectively will seek a spinal cord and so on.

  • @scenFor109
    @scenFor109 Рік тому

    I like the notion that the universe is an ultra-superconductor. Where gravity is a just a rule to help keep things cool.

  • @jmachorrov
    @jmachorrov Рік тому

    Dave love your ideas i am thinking of receiving in correlator information of the other antenas and to proces EHT or SKA

  • @kitastro
    @kitastro Рік тому

    Everyone here is interesting too bad they only had so little time. but still a good overview Thank you all. I'll try and look for other videos from these speakers

  • @tuckerbugeater
    @tuckerbugeater Рік тому

    They should just start wearing one piece jumpsuits already

  • @keithallpress9885
    @keithallpress9885 Рік тому

    Speaking of goals, the growth of plants always impressed me, in that eventually the rate of growth doesn't depend on how much it has grown but on the computation of how much it has yet to grow. You must be able to model this in a toy system without explicitly storing the goal height. Anyways maybe this is some kind of hormonal feedback. That is something else that distinguishes brains, they are bathed in a neurochemical soup.

    • @davidkemp3154
      @davidkemp3154 Рік тому

      Plants also furnish consciousness tools to determine truth. Only life can embed truth as thought underlays the dynamic of consciousness & plants like poppy or cannabis derive their own specific inputs into society itself. Every 10 mins an American dies of fentanyl od which is a poppy derivative high for example.

  • @mistycloud4455
    @mistycloud4455 Рік тому

    we need to understand how the brain computes we dont need too much biology, just like neural networks, we need to understand how the brain connects and how it processes data

  • @mrnitro30103
    @mrnitro30103 Рік тому

    so fascinating the part about the consciousness...

  • @subjekt5577
    @subjekt5577 Рік тому

    I feel soo seen, super happy people smarter and better at execution than I are able to not only figure this out but also fucking provide concrete evidence of such Damn what a cool video

  • @ccatctc
    @ccatctc Рік тому

    Tremendous - all 3 speakers great, so much food for thought, complexity with a top-down approach as discussed by George Ellis. What is missing is characterisation of how the Universe itself works, which should really be an area of focus, since ultimately it determines all that is possible, including life and AI.

  • @Ms.Robot.
    @Ms.Robot. Рік тому

    Wo🤯 Thanks‼️💋

  • @waleedalshumrani
    @waleedalshumrani Рік тому

    Good topic! But didn’t really answer anything. fear? The question is why do we fear them? while completely harmless.. we don’t fear mosquitoes while its the first killer to human! And they are harmful.

  • @deansing2405
    @deansing2405 Рік тому

    what about the octopus?

  • @briancase9527
    @briancase9527 Рік тому

    "Once you can move very quickly, you need to perceive very quickly." Or, at least as likely, the other way around: once you can perceive quickly, you evolve the means to move quickly.

  • @scientious
    @scientious Рік тому

    This might be interesting. 1:39 Wow, this is starting off bad. Joscha is not very well informed on this topic. I will accept his statement that he doesn't know, but this is actually known. It actually can be proven that deep learning cannot be used to create artificial general intelligence. 3:35 The actual problem is not computational capacity, but this would be a typical assumption from someone who mistakenly believes computational/brain equivalence (as Joscha apparently does). 4:35 Okay, that's a correct statement, estimating by computation per neuron doesn't work. 5:11 His definition of intelligence is wrong but again would be consistent when viewed from a computational reference. 6:00 And again, he confirms his computational reference (which is incorrect). 7:25 No, this is incorrect. Deep learning exhibits the same scaling problem as anything based on computation. 8:25 I'm sorry but this is just idiotic. Any deep learning model of any size that is trained to identify pictures is inferior to what a four year old can do. The deep learning method does not provide learning of an equivalent type to human; it simply isn't there. Pretending that it is there or is close or is getting there is self delusion of a high order. 28:00 His description of alternatives to deep learning as well as his description of neural function is pretty bad. 32:30 Here I can see Joscha trying to grasp some of these concepts but he doesn't understand them either in detail or how they fit together. Still, that is encouraging since most people who claim to be researching AGI are considerably further behind. 33:26 Yes, time is a factor. Some of his intuition is correct, but he still has that computational bias. I had similar conceptual struggles in my research about 8 years ago and he's a little further back than that, so maybe 10 years behind. 34:40 No, that isn't how it works. That is a computational model rather than a brain model. 36:44 Transfer by RNA -- we're off the deep end again. This was a fad theory in science and used in science fiction for awhile, but there's nothing to it. The brain does not store records as RNA. 37:00 Agnostic to the neuron. This could either be correct or incorrect depending on how it is meant. 44:00 Definitely on the wrong research path if he is trying to develop AGI. 47:00 His understanding of control in the brain is lacking. 54:00 Michael's rambling dialog is saying very little. Massive overuse of the phrase, "we can talk about this." 1:10:00 He's made a couple of good points but mostly misses the mark. 1:14:00 Goal scaling is not a good analogy for AGI. But that would be consistent with someone who mistakenly thinks that AI can be scaled up to AGI. 1:22:00 His path to AGI is a joke. I noticed that he is leaning on the term "emergence" which is something I never use. This term is nothing more than a euphemism for "I have no idea how this works but I don't want to admit my ignorance." Consciousness is not an emergent property and no amount of wishful thinking will make that true. 1:24:00 The fact that he is talking about a belief in free will rather than the science of free will shows that he is very far behind in his understanding of this topic. The best I can say about his contribution is that it is true that biological consciousness can only be understood in terms of evolutionary theory. These constraints cannot be completely dismissed even when consciousness is non-biological which would mean that he is probably vastly overestimating the potential variety of cognitive systems. 1:28:00 Christoph is correct about attractor dynamics in the brain. However, he then mentions states which is a term borrowed from computational theory and likewise uses the euphemism of emergence. Coincidences of signals is also incorrect. So, it's pretty clear that he does not understand this topic either. 1:33:00 He is confusing predictive modeling with environmental modeling; these are not the same. 1:37:00 What is missing from AI is biological behavioral goals? Intelligence is just the ability to pursue those goals in a changing context? No. This has nothing to do with AGI. That's enough. This has been mostly a waste of time except to see how far behind the public research field is in terms of AGI theory.

  • @marcfruchtman9473
    @marcfruchtman9473 Рік тому

    Great presentations.

  • @JAYMOAP
    @JAYMOAP Рік тому

    Great convo guys 🔥👍

  • @ralphclark
    @ralphclark Рік тому

    Hilarious watching all these giant intellects struggling with Zoom and PowerPoint. I’m so glad it’s not just me 😅

  • @scorchgardenultrahothotsau7919

    I am, by far, the dumbest person in the room. Wow. Just wow. I saw Pong to AI in my lifetime and there is still so much more to come.

  • @miao6487
    @miao6487 Рік тому

    Sir Malsburg thanks so much for your patience and evidently for your knowledge.