BRN Discussion Ongoing

[Diogenese]

One item Luca (Prophesee) referred to was the deblurring of mobile camera images by using a frame camera and a DVS camera.

This is their patent:
EP3929864A1 IMAGE ENHANCEMENT METHOD, APPARATUS AND SYSTEM

an image enhancement method, comprising:

• obtaining a reference image frame of a scene, by a frame-based sensor, which contains artifacts and has an exposure duration; [#### frame based camera]
• obtaining a stream of events, by an event-based sensor which is synchronized with the frame-based sensor, at least during the exposure duration of the reference image frame, wherein the events encode brightness changes of the scene corresponding to the reference image ; and
• deriving a corrected image frame without the artifacts from the reference image by means of the stream of events.

"artifacts" in this context means unintentionally generated image element (pixel activations) caused by movement of an object while the shutter is open.

The "stream of events" refers to the activation of individual pixels caused by motion of the object captured by the DVS during a single frame period of the standard camera. The DVS pixel data includes the time at which the pixel illumination changed. Thus the system can use the timing information contained in the DVS data to correct the blurring of the camera image which occurred due to movement of the object during the frame period.

 

[Diogenese]

On that note I thought it would be helpful to provide the following list of published Prophesee partners for @Diogenese:

1. Sony

2. Century Ark

3. IMAGO - SpaceX seems to be a customer

4. Datalogic

5. LUCID

6. CIS Corporation

7. FRAMOS Imaging

8. MV Technology

9. Renault

By extension these are all now part of the growing Brainchip Ecosystem.

My opinion only DYOR
FF

AKIDA BALLISTA

Well it's good to be able to put a name to the haystacks ...

The problem is that the haystacks are undercover for 18 months, so nothing filed since 4 April 2021 is available to the public.

Since we only recently teamed up with Prophesee and since it will take several months to implement in silicon, I'd say it's a bit too early for a Prophesee/Akida combo.

 

[HopalongPetrovski]

Well it's good to be able to put a name to the haystacks ...

 

[Diogenese]

Recent news suggests a continued emphasis on AI utilisation for autonomy. Someone should really sell Elon the benefits on on-chip learning.

View attachment 18147

AI Integration Software Engineer, Autonomy​

Job Category	Autopilot & Robotics
Location	PALO ALTO, California
Req. ID	136288
Job Type	Full-time

Apply
Tesla participates in the E-Verify Program

What to Expect
As an AI Integration Software Engineer within the Autonomy group, you will have the opportunity to apply your technical skills to foundational code targeting automation, validation, and optimization of AI workloads for Autopilot and Humanoid robot. The nature of the role is multi-disciplinary, and it means that the code you will write, debug, and maintain will contribute to deploying Neural Networks trained by Machine Learning engineers. You will be developing system tools to benchmark, characterize and optimize the latency and throughput of the AI workloads on the FSD chip. You will write tests and integrate with our evaluation pipeline to continuously validate the AI deployment flow.

What You’ll Do

• Write, debug and maintain robust software for Autopilot and Humanoid robot AI deployment stack; depending on needs and your interests/skills, you might work on code related to our Camera & Vision stack, write custom GPU kernels for AI models, or make our NN evaluation software more stable and performant.
• Automate the flow of deploying Neural Networks and reduce the time it takes for AI models to go from Pytorch land to Tesla cars.
• Optimize Tesla's in-house AI ASIC resources usage by profiling the Neural Network execution, consult with both AI scientists and hardware architects and introduce new features in the Neural Network deployment stack.
• Advocate for best coding practices amongst the group, build tools helping engineers to write better code (for instance, performance/memory tracking)

What You’ll Bring

• Experience programming C/C++ including modern C/C++ (C++14/17/20), and Python.
• Experience or familiarity with Computer Vision, Machine Learning & related software concepts.
• Experience with performant software design, compiler design and/or hardcore lower-level C code.
• Experience with at least one of the following preferred: Cuda/OpenCL, SIMD, and multithreading.

Tesla is an Equal Opportunity / Affirmative Action employer committed to diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, age, national origin, disability, protected veteran status, gender identity or any other factor protected by applicable federal, state or local laws.

Tesla is also committed to working with and providing reasonable accommodations to individuals with disabilities. Please let your recruiter know if you need an accommodation at any point during the interview process.

For quick access to screen reading technology compatible with this site click here to download a free compatible screen reader (free step by step tutorial can be found here). Please contact accommodationrequest@tesla.com for additional information or to request accommodations.

Privacy is a top priority for Tesla. We build it into our products and view it as an essential part of our business. To understand more about the data we collect and process as part of your application, please view our Tesla Talent Privacy Notice.

AI Inference Software Engineer, Autonomy | Tesla Careers

Apply for the AI Inference Software Engineer, Autonomy position in PALO ALTO, California.

www.tesla.com

"custom GPU kernels for AI models" is so last milennium.

 

[Fact Finder]

Well it's good to be able to put a name to the haystacks ...

The problem is that the haystacks are undercover for 18 months, so nothing filed since 4 April 2021 is available to the public.

Since we only recently teamed up with Prophesee and since it will take several months to implement in silicon, I'd say it's a bit too early for a Prophesee/Akida combo.

Don’t worry spikes are bigger than needles and as Rob Telson said if you are looking for a spike in a haystack just use AKIDA because it will only see the spikes not all the hay. Here is a photo to assist:

Regards
FF

AKIDA BALLISTA

 

[Diogenese]

One item Luca (Prophesee) referred to was the deblurring of mobile camera images by using a frame camera and a DVS camera.

This is their patent:
EP3929864A1 IMAGE ENHANCEMENT METHOD, APPARATUS AND SYSTEM

an image enhancement method, comprising:

• obtaining a reference image frame of a scene, by a frame-based sensor, which contains artifacts and has an exposure duration; [#### frame based camera]
• obtaining a stream of events, by an event-based sensor which is synchronized with the frame-based sensor, at least during the exposure duration of the reference image frame, wherein the events encode brightness changes of the scene corresponding to the reference image ; and
• deriving a corrected image frame without the artifacts from the reference image by means of the stream of events.

"artifacts" in this context means unintentionally generated image element (pixel activations) caused by movement of an object while the shutter is open.

The "stream of events" refers to the activation of individual pixels caused by motion of the object captured during a single frame period of the standard camera. The DVS pixel data includes the time at which the pixel illumination changed. Thus the system can use the timing information contained in the DVS data to correct the blurring of the camera image which occurred due to movement of the object during the frame period.

You may (or may not) recall the mechanical photo finish camera used at Randwick where the film was rolled past a slit aligned with the finish post at a speed equivalent to the speed of the horse adjusted for the difference between the horse and the slit and the film and the slit (say 30 m to 1 cm at 40 mph ... so 40/3000 mph). The horse legs came out bent because the legs moved faster than the body of the horse.

 

[Diogenese]

I'd like that job!

 

[HopalongPetrovski]

You may (or may not) recall the mechanical photo finish camera used at Randwick where the film was rolled past a slit aligned with the finish post at a speed equivalent to the speed of the horse adjusted for the difference between the horse and the slit and the film and the slit (say 30 m to 1 cm at 40 mph ... so 40/3000 mph). The horse legs came out bent because the legs moved faster than the body of the horse.

It's a common problem. The classic example is trying to photograph a golf swing. Even very expensive club's tend to get bent.
And not in the gooD way!
They might be able to solve the banding issue in video as well, combining the relevant data from an event camera with a regular one.
In fact, this may just turn out to be the answer for many common photographic issues.
I wonder if this is something Sony are looking at as they would love to have this technical edge on Cannon.

 

[HopalongPetrovski]

I'd like that job!

Yeah, just don't forget where you lent your pitchfork though.

 

[JK200SX]

One item Luca (Prophesee) referred to was the deblurring of mobile camera images by using a frame camera and a DVS camera.

This is their patent:
EP3929864A1 IMAGE ENHANCEMENT METHOD, APPARATUS AND SYSTEM

an image enhancement method, comprising:

• obtaining a reference image frame of a scene, by a frame-based sensor, which contains artifacts and has an exposure duration; [#### frame based camera]
• obtaining a stream of events, by an event-based sensor which is synchronized with the frame-based sensor, at least during the exposure duration of the reference image frame, wherein the events encode brightness changes of the scene corresponding to the reference image ; and
• deriving a corrected image frame without the artifacts from the reference image by means of the stream of events.

"artifacts" in this context means unintentionally generated image element (pixel activations) caused by movement of an object while the shutter is open.

The "stream of events" refers to the activation of individual pixels caused by motion of the object captured by the DVS during a single frame period of the standard camera. The DVS pixel data includes the time at which the pixel illumination changed. Thus the system can use the timing information contained in the DVS data to correct the blurring of the camera image which occurred due to movement of the object during the frame period.

Straight out of the podcast!

 

[JoMo68]

I am sure you remember a while back the very negative response a poster received from Ryad Benosman the cofounder of Prophesee regarding AKIDA. Clearly that response was born out of a desire to suppress speculation about a relationship between Brainchip and Prophesee.

On looking up Mr. Benosman just now I found this further interesting connection:

https://www.ri.cmu.edu/ri-people/ryad-benosman/

Carnegie Mellon University.

My opinion only DYOR
FF


AKIDA BALLISTA

I thought exactly the same thing myself FF. Wondering if our MB friend’s “not that one” response when asked about Akida IP was in the same vein as Benosman’s negative comments - smoke and mirrors…

 

[Violin1]

Well it's good to be able to put a name to the haystacks ...

The problem is that the haystacks are undercover for 18 months, so nothing filed since 4 April 2021 is available to the public.

Since we only recently teamed up with Prophesee and since it will take several months to implement in silicon, I'd say it's a bit too early for a Prophesee/Akida combo.

Didn't Luca say they'd been collaborating for a couple of years? Might be wrong but thought there was a suggestion in there somewhere.


CORRECTION - I WENT BACK AND RELISTENED TO THE SECTION AND IT ISN'T THERE. CLEARLY MY WISHFUL THINKING!
ps - love the edit button!!

 

[Cgc516]

Why BRN still give them chance to do so!
Why ASX allows them keep doing it ?

 

[Zedjack33]

Why BRN still give them chance to do so!
Why ASX allows them keep doing it ?


View attachment 18156

The last 3 minutes of trading was piss poor. What a joke.

 

[Diogenese]

Didn't Luca say they'd been collaborating for a couple of years? Might be wrong but thought there was a suggestion in there somewhere.

Hope you're right!

 

[Violin1]

Hope you're right!

Hi big D - I've corrected my post as I relistened and couldn't find it. Bummer.

 

[Xray1]

IMO..... A good Co announcement came out this afternoon...!!!!
Seems like a couple of the employee's at BRN, know that their onto something good and big ..... thus enticing them to take up a significant amount of options.

 

[Diogenese]

Hi big D - I've corrected my post as I relistened and couldn't find it. Bummer.

Well there would have been some months of cooperation before the agreement was announced.

The SynSense/Prophesee partnership was announced a year ago, so I think it's unlikely that the Prophesee/BrainChip cooperation goes back much before that ... but I still hope you're right.

 

[Diogenese]

IMO..... A good Co announcement came out this afternoon...!!!!
Seems like a couple of the employee's at BRN, know that their onto something good and big ..... thus enticing them to take up a significant amount of options.

I'm pretty sure that a lot of BRN employees know they're onto a good thing.

 

[Cardpro]

I'm pretty sure that a lot of BRN employees know they're onto a good thing.

Yes, I've read few employer reviews and if I recall correctly, although someone complained about the management, almost everyone (including the person who complained) said the work is very interesting & innovative or something along those lines.