BRN Discussion Ongoing

[Diogenese]

Hi FF,
This paragraph at the bottom of column 1 of page 15 discusses memory.

The original motivation for this model was to obtain a realistic description of associative memory occurring on top of spontaneous brain activity with the latter being a global attractor of the dynamics. In a later version in which neural clusters can overlap (modeling the fact that real neurons can code for more than one stimulus), this model is the closest biologically plausible analog so far of the influential Amari–Hopfield network (discussed below in Sec. VB3) and can store an extensive number of stimuli modeled as patterns of firing rates across neurons.

My neuroscientific layman's guess is that, in Akida, the model libraries and associated weights are equivalent to memory. Coding neurons for more than one stimulus is performed in Akida by selecting a different model from the library.

So my question is, can Akida be, to some extent, adapted to cortical neuron configuration by configuration of the data in the model, and to what extent is hardware modification required to enable cortical operation? Does this involve modification of the NPUs or the interconnexion matrix, or both?

The existence of this kind of metastable dynamics in a spiking network was first pointed out in Refs. 16 and 17 who noticed that, because of metastable activity, the network produces slow fluctuations in the neural activity, much slower than the time scales of the single neurons—the origin of such timescales is a long-standing problem in theoretical neuroscience.170–172 They also showed that, unlike the case of a homogeneous excitatory population, a stimulus will suppress trial-to-trial fluctuations, another widespread phenomenon in cortical circuits.173 Reference 22 also found that, in this clustered network, the dimensionality of the neural activity (Sec. VA3) is larger during ongoing metastable dynamics than when the network is externally stimulated.

I think what this is saying is that concentration suppresses idle thoughts, much like changing from an idling motor to engaging drive. Or, in the case of Akida, the model is loaded, but there is no input. There may be degrees of concentration, like thinking about doing something and actually doing something.

Reminds me of the time I was taking a young lady for a drive in a rather sporty automobile, and she mentioned that the engine was rather noisy. I explained that that was the acoustic tachometer ... you know that look you get ...

This bit discusses working memory and decision making (Page 25):

Actively holding information online for a brief period of time (seconds) is an important ability of the brain. This capability is a part of working memory (WM), which is used for tasks such as planning, organizing, movement preparation, and decision making.281–284 In contrast to long-term memory, which requires structural changes in neural circuits and in the connections between neurons, the mechanisms underlying working memory are believed to depend on persistent neuronal activity.285–287 In general, positive reverberation driven by recurrent synaptic excitation in interconnected neural clusters can work as the basic principle for generating persistent activity. Triggered by incoming signals, working memory circuits can sustain an elevated firing even after the inputs are withdrawn. As discussed in Sec. VB1 [see, e.g., Fig. 6(a)], dynamical models with local feedback excitation between principal neurons that are controlled by global feedback inhibition can exhibit multiple attractor states (each coding a particular memory item) that coexist with a background (resting) state. This is illustrated in Fig. 11 for a circuit model of WM with two excitatory populations.

In Akida 2000, LSTM will be a static equivalent of the dynamic "positive reverberation driven by recurrent synaptic excitation. ".

"In addition to robust maintenance of memory states, activity should be reset quickly when there is a novel sensory cue that needs to be stored. In other words, a working memory system should have the properties of robustness against fluctuations while being very sensitive to incoming stimuli. In recent theoretical works, this fundamental contradiction can be achieved by global inhibitory connections, where the system can exhibit structurally stable dynamics with fixed stimulus and qualitatively change its dynamics if the stimulus is changed."

I learnt a long time ago that academics proposing to provide a review of an entire area of science are having a lend and just trying to keep up their academic publication numbers which are apparently important in CV's for promotion in their world.

Poor old Peter van der Made would not get a job based on publications at the moment as he has been in stealth mode for years now.

I only posted the extract as being the easy read as I have searched for ages for someone prepared to encapsulate the outcome of understanding and creating a simulation of a cortical column. As for the maths I always assume that is correct and peer reviewed as I could not check it anyway.

The philosophy of whether we will ever understand the human brain using the human brain to derive an understanding and allowing for the variation in human brains and ongoing evolution is an intellectual quandary that I often mull over and cannot resolve. It does seem the more those engaged in this endeavour learn the less they know.

Personally I think that the human brain is a flawed model upon which to build useful artificial intelligence. The human brain makes mistakes constantly hence the saying "To err is human to forgive divine" or something like that. Being human not sure if I am misquoting but I will quote it nonetheless as I am using a flawed human brain to construct this response.

What use is an intelligent machine that perfectly mimics the human brain down to the making of inexplicable mistakes and the ego to keep going at it regardless.

In Autonomous EV's the push is in large part so that they can remove human drivers and eliminate accidents. Go figure that one out when you read about attempts to emulate the human brain to create truly autonomous vehicles. I am not Einstein but the logic breaks down in my opinion.

In short the artificial general intelligence that Peter van der Made is seeking must at some point divert from the position of fully replicating the human brain and as such a complete understanding of the human brain and how it works is unnecessary to this goal in my opinion but what would I know I am human after all and constantly right and wrong unless you ask my wife who will tell you I am constantly wrong unless I agree with her unless it comes to the law and investment and doing our tax planning.

My opinion only DYOR
FF

AKIDA BALLISTA

On-chip learning goes a way to meeting the requirement to store novel sensory cues.
...
Conclusion (Page 30)
One of the most relevant implications of the fact that cortical activity evolves as a sequence of discrete, metastable states is that transitions in neural activity are not just triggered by external events, such as a stimulus or a reward, but are instead spontaneously generated and may occur at anytime, including when the subject is idling and not engaged in a task. This goes against the notion that neural activity is just a “reaction” to external events or a static representation of incoming stimuli and is compatible with the presence of incessant “ongoing activity” observed in the cortex.

As FF asks, to what extent is it necessary to reproduce daydreaming?

 

[mkg6R]

Hey guys tomorrow is a fresh month. Anything in particular thats on the cards for brainchip this month?

 

[Diogenese]

My immediate thought was the difference between the amount of concentration I give to your posts and the rocket memes of Rocket. LOL

I actually get what you are saying strangely enough.

One of the things I have wondered about is monitoring for noise and or vibration. Your sportscar analogy reminded me of it. Most of us have had the experience of someone new such as your young lady getting into our car and a couple of hundred metres down the road being asked what is that knocking sound or tap or something. Replying I can't hear anything out of the ordinary only to find later that some part had been wearing away over a long time and it was the cause of the noise detected by the young lady and not noticed by ourselves.

I have explained this away in the past to myself on the basis that it occurred so gradually over time that I became used to this noise. So the question I have is why would this not happen to an intelligent device monitoring for noise or vibration in a motor? The answer is I assume that there must be some way to set it to remember a perfect state and that any variation or noise outside that perfect state will be what it detects.

Now herein is my question. As no two mechanical devices will be in perfect harmonic balance one with the other it seems to me you would need to have an intelligent device that can learn that perfect state on the factory floor so to speak for the particular piece of machinery as it would be impossible to program every piece of individual piece of machineries noise or vibration perfect state in a central memory. In other words you ideally need on chip training preferably one or several shot in nature. Do you disagree?

My opinion only DYOR
FF

AKIDA BALLISTA

Hi FF,

My understanding is that there would be a range of acceptable vibrations either side of the "ideal" vibration, and, of course, the acceptable vibrations would be dependent on the rotational speed of the device.

So providing the individual machine's earprint is within the acceptable range, it should pass muster. But, I hear you say, if one machine is in the upper part of the acceptable range, and another machine is in the lower part of the acceptable range, is there not a greater chance of missing when one or the other approaches its damage threshold. And of course you would be right to be so concerned. So that may well be where the on-chip learning comes in to adjust the acceptable bandwidth to the individual machine by determining the "centre" about which the allowable variations could occur.

Or maybe, its just that the change from acceptable to "damaged" is so great that individual variations don't matter. After all, in the old days, an experienced mechanic could press his ear to a strategically placed screwdriver in the manner of a stethoscope to diagnose unhealthy rattles.

And, since we are moving to electric vehicles, there will be fewer bearings to monitor.

 

[Fullmoonfever]

2024: The year that the future arrives

Days of future past… There are movies I enjoyed in childhood that strongly date themselves, presenting visions of a possible future on dates that are now

www.technologyslegaledge.com

Technology's Legal Edge​

A Global Technology Sector Blog

2024: The year that the future arrives​

By Gareth Stokes on March 17, 2022
Posted in Artificial Intelligence, Hardware

Excerpt.

Sticking with silicon, various companies are exploring ways of delivering lower power solutions that will allow AI in a much wider range of devices. Two notable examples are Brainchip’s akida processors and Mythic’s analog (or ‘analogue’ in British English) AI processors. Brainchip’s akida takes a ‘neuromorphic’ approach, mimicking the spiking of neurons in the human brain. By contrast, Mythic’s chips take advantage of the electronically simpler designs for multiplication and addition operations in the analogue domain, for a different approach to low power AI inference solutions.

 

[JoMo68]

This bit discusses working memory and decision making (Page 25):

Actively holding information online for a brief period of time (seconds) is an important ability of the brain. This capability is a part of working memory (WM), which is used for tasks such as planning, organizing, movement preparation, and decision making.281–284 In contrast to long-term memory, which requires structural changes in neural circuits and in the connections between neurons, the mechanisms underlying working memory are believed to depend on persistent neuronal activity.285–287 In general, positive reverberation driven by recurrent synaptic excitation in interconnected neural clusters can work as the basic principle for generating persistent activity. Triggered by incoming signals, working memory circuits can sustain an elevated firing even after the inputs are withdrawn. As discussed in Sec. VB1 [see, e.g., Fig. 6(a)], dynamical models with local feedback excitation between principal neurons that are controlled by global feedback inhibition can exhibit multiple attractor states (each coding a particular memory item) that coexist with a background (resting) state. This is illustrated in Fig. 11 for a circuit model of WM with two excitatory populations.

In Akida 2000, LSTM will be a static equivalent of the dynamic "positive reverberation driven by recurrent synaptic excitation. ".

"In addition to robust maintenance of memory states, activity should be reset quickly when there is a novel sensory cue that needs to be stored. In other words, a working memory system should have the properties of robustness against fluctuations while being very sensitive to incoming stimuli. In recent theoretical works, this fundamental contradiction can be achieved by global inhibitory connections, where the system can exhibit structurally stable dynamics with fixed stimulus and qualitatively change its dynamics if the stimulus is changed."



On-chip learning goes a way to meeting the requirement to store novel sensory cues.
...
Conclusion (Page 30)
One of the most relevant implications of the fact that cortical activity evolves as a sequence of discrete, metastable states is that transitions in neural activity are not just triggered by external events, such as a stimulus or a reward, but are instead spontaneously generated and may occur at anytime, including when the subject is idling and not engaged in a task. This goes against the notion that neural activity is just a “reaction” to external events or a static representation of incoming stimuli and is compatible with the presence of incessant “ongoing activity” observed in the cortex.

As FF asks, to what extent is it necessary to reproduce daydreaming?

The musings of my day job... working memory, planning and organisation, decision-making...love it! Working memory was once considered a proxy measure for intellect...

 

[Esq.111]

Hey guys tomorrow is a fresh month. Anything in particular thats on the cards for brainchip this month?

Afternoon mkg6R,

For the month of April I only have three events penciled in so far,

1, April 2 , Pod cast, Chit chat with Chairman of Foundries.io.

2, April 17, OTC Markets, Technology Virtual Investor Confrence, BRN presenting.

3, April 29, 4C, Quarterly Report, ( possibly disclosing multiple billion $ contracts ) , * That last bit I added, unlikely but possible.

& today , March 31, I thought we were going to receive the Audited Accounts.???

BRN Shareholders need some, Positive reverbiration driven by recurrent synaptic exitation.

I have stolen this bit from one of Diogenese posts.

Regards,
Esq.

 

[McHale]

Hi FF,

Now you've triggered one of my pet peeves.

This is the biography of "those who without any connection to the real world (where we all live) are able to manipulate politicians, regulators, the media":
Davos Man
How the billionaires devoured the world
by Peter S Goodman
https://www.dymocks.com.au/book/davos-man-by-peter-s-goodman-9780063239340

They're not very nice people, but IMO Klaus Schwab (WEF) is the main man, piece of work.

 

[Fact Finder]

My immediate thought was the difference between the amount of concentration I give to your posts and the rocket memes of Rocket. LOL

I actually get what you are saying strangely enough.

One of the things I have wondered about is monitoring for noise and or vibration. Your sportscar analogy reminded me of it. Most of us have had the experience of someone new such as your young lady getting into our car and a couple of hundred metres down the road being asked what is that knocking sound or tap or something. Replying I can't hear anything out of the ordinary only to find later that some part had been wearing away over a long time and it was the cause of the noise detected by the young lady and not noticed by ourselves.

I have explained this away in the past to myself on the basis that it occurred so gradually over time that I became used to this noise. So the question I have is why would this not happen to an intelligent device monitoring for noise or vibration in a motor? The answer is I assume that there must be some way to set it to remember a perfect state and that any variation or noise outside that perfect state will be what it detects.

Now herein is my question. As no two mechanical devices will be in perfect harmonic balance one with the other it seems to me you would need to have an intelligent device that can learn that perfect state on the factory floor so to speak for the particular piece of machinery as it would be impossible to program every piece of individual piece of machineries noise or vibration perfect state in a central memory. In other words you ideally need on chip training preferably one or several shot in nature. Do you disagree?

My opinion only DYOR
FF

AKIDA BALLISTA

Hi FF,

My understanding is that there would be a range of acceptable vibrations either side of the "ideal" vibration, and, of course, the acceptable vibrations would be dependent on the rotational speed of the device.

So providing the individual machine's earprint is within the acceptable range, it should pass muster. But, I hear you say, if one machine is in the upper part of the acceptable range, and another machine is in the lower part of the acceptable range, is there not a greater chance of missing when one or the other approaches its damage threshold. And of course you would be right to be so concerned. So that may well be where the on-chip learning comes in to adjust the acceptable bandwidth to the individual machine by determining the "centre" about which the allowable variations could occur.

Or maybe, its just that the change from acceptable to "damaged" is so great that individual variations don't matter. After all, in the old days, an experienced mechanic could press his ear to a strategically placed screwdriver in the manner of a stethoscope to diagnose unhealthy rattles.

And, since we are moving to electric vehicles, there will be fewer bearings to monitor.

Thanks once again.

I had a mate who would tune the twin su’s on my sports car with a piece of hose stuck in his ear and the other end held in front of each air intake and he would move the hose back and forth until he had them sounding exactly the same.

I wonder if Robot Ken could do this.
FF

 

[Fact Finder]

Afternoon mkg6R,

For the month of April I only have three events penciled in so far,

1, April 2 , Pod cast, Chit chat with Chairman of Foundries.io.

2, April 17, OTC Markets, Technology Virtual Investor Confrence, BRN presenting.

3, April 29, 4C, Quarterly Report, ( possibly disclosing multiple billion $ contracts ) , * That last bit I added, unlikely but possible.

& today , March 31, I thought we were going to receive the Audited Accounts.???

BRN Shareholders need some, Positive reverbiration driven by recurrent synaptic exitation.

I have stolen this bit from one of Diogenese posts.

Regards,
Esq.

Or was it the BeeGee’s? FF

 

[mrgds]

Now that is one BOLD statement FF,... and to be more specific, .... " Brainchip is on a trajectory to success that if achieved will be unlike anything ever seen before in the commercial and scientific world."

That's triple expresso bold. Not that I disagree necessarily, but I am less confident on that outcome, let us say. I'd be happy with just the Nasdaq 100.

Fortunately, you left an escape exit by use of a qualifying " if...". Sneaky,.... You sure do craft wonderful positions usually supported with good proof or evidence. Keep up the great work and be as colorful as you wish. Sometimes you crack me up, though,....

Or was it the BeeGee’s? FF

Maybe Beachboys ? ................ Good "vibrations", and "exitations"

beach boys good vibrations - Yahoo Video Search results

The search engine that helps you find exactly what you're looking for. Find the most relevant information, video, images, and answers from all across the Web.

au.video.search.yahoo.com

 

[Fact Finder]

They're not very nice people, but IMO Klaus Schwab (WEF) is the main man, piece of work.

An interesting insight into your main man. LOL:

“He Has an Incredible Knack to Smell the Next Fad”: How Klaus Schwab Built a Billionaire Circus at Davos

The überrich flock annually to the World Economic Forum, where they can schmooze and strike deals under the guise of saving the world. A new book reveals how its founder benefits from this gathering of the global elite.

www.vanityfair.com

FF

 

[equanimous]

Thanks once again.

I had a mate who would tune the twin su’s on my sports car with a piece of hose stuck in his ear and the other end held in front of each air intake and he would move the hose back and forth until he had them sounding exactly the same.

I wonder if Robot Ken could do this.
FF

FF we just need your tuning requirements please. We are working on it

 

[Fact Finder]

Maybe Beachboys ? ................ Good "vibrations", and "exitations"

beach boys good vibrations - Yahoo Video Search results

The search engine that helps you find exactly what you're looking for. Find the most relevant information, video, images, and answers from all across the Web.

au.video.search.yahoo.com

Yes I think your right the Beach Boys ‘She’s giving me ….’
FF

 

[Slade]

Yes I think your right the Beach Boys ‘She’s giving me ….’
FF

....good neuromorphic registered vibrations

 

[equanimous]

If anyone wants their own custom Robot let me know.

 

[Fact Finder]

An all weather garden care robot would go down a treat. This rain has incited rebellion amongst the plants, weeds, shrubs and trees in our garden and they are planning a takeover as I type. FF

 

[Diogenese]

They're not very nice people, but IMO Klaus Schwab (WEF) is the main man, piece of work.

Come the revolution, there's a lot of billionaires lined up against the wall ...

An all weather garden care robot would go down a treat. This rain has incited rebellion amongst the plants, weeds, shrubs and trees in our garden and they are planning a takeover as I type. FF

It was years ago when "gardening" at my place became jungle warfare.

Still, the frogs love it ...

 

[VictorG]

An all weather garden care robot would go down a treat. This rain has incited rebellion amongst the plants, weeds, shrubs and trees in our garden and they are planning a takeover as I type. FF

 

[Dhm]

I was really hoping that our SP would get a wriggle on today as the US version closed at US 78c which equates to AUD$1.04 with an exchange rate of .7480. Yet another offshore movement not followed up at home. Soon, soon........

 

[jla]

I was really hoping that our SP would get a wriggle on today as the US version closed at US 78c which equates to AUD$1.04 with an exchange rate of .7480. Yet another offshore movement not followed up at home. Soon, soon........

Only200 shares took it from $71.90 to $78 so i don't think it would have made any difference to us.