RayOnStorage Blog

Deepmind does chat

Read an article this week on Deepmind’s latest research into developing a chat agent (Improving alignment of dialogue agents via targeted human judgements). Lot’s of interesting approaches have been applied to chat but even today, most chat model’s are rife with problems, that include being bigoted, profane, incorrect, etc. Reinforcement learning vs. deep neural networks…

Keep reading

NVIDIA’s H100 vs A100, the good and bad news

Turns out only the current MLPerf v2.1 Data Center Inferencing results show both NVIDIA Hopper H100 and prior generation NVIDIA A100 GPUs on similar workloads so that we can compare performance. Hopper (H100) results are listed as CATEGORY: Preview, so final results may vary from these numbers (but, we believe, not by much). For the…

Keep reading

MTJ’s everywhere

I attended a IEEE Magnetic’s Society Distinguished Lecture series on MTJ (magnetic tunnel junction) which technology has been under development since 1960. It turns out since about 2004, the TMR (tunneling magneto-resistance) read head based on MTJs has been the dominant technology used in HDDs for reading magnetic bits recorded on media. TMR is a…

Keep reading

The killer (space) app

Salvaging or recycling the International Space Station (ISS) is the killer app. There’s so much there that could be re-used, it would be a dying shame to have it be deorbited, burned up and crashed into the ocean somewhere. Yes recycling the ISS is monumental today. Yes the probability of success is slim (at the…

Keep reading

Safe AI

I’ve been writing about AGI (see part-0 [ish], part-1 [ish], part-2 [ish], part-3ish, part-4 and part 5) and the dangers that come with it (part-0 in the above list) for a number of years now. My last post on the subject I expected to be writing a post discussing the book Human compatible AI and the problem of control…

Keep reading

Is AGI just a question of scale now – AGI part-5

Read two articles over the past month or so. The more recent one was an Economist article (AI enters the industrial age, paywall) and the other was A generalist agent (from Deepmind). The Deepmind article was all about the training of Gato, a new transformer deep learning model trained to perform well on 600 separate…

Keep reading

Better autonomous drone flying with Neural-Fly

Read an article the other day on Neural-Fly (see: Rapid adaptation of deep learning teaches drones to survive any weather) based on research out of CalTech documented in a paper is ScienceRobotics (see: Neural-Fly enables rapid learning for agile flight in strong winds, behind paywall). Essentially they have trained two neural networks (NN) at the…

Keep reading

Living forever – the end of evolution part-3

Read an article yesterday on researchers who had been studying various mammals and trying to determine the number of DNA mutations they accumulate at about the time they die. The researchers found that after about 800 mutations for mole rats, they die, see Nature article Somatic mutation rates scale with lifespan across mammals and Telegraph…

Keep reading

Go big or go home for robust DNNs

Read a recent article Computer Scientists Prove why Bigger NNs do better discussing scientific research that proved a Universal Law of Robustness via Isoperimetry. This speaks to the perturbability of AI deep learning neural networks (DNN) and how not reduce it. But also applies to many other solutions to diverse multi-dimensional data problems. Mathmatical Robustness…

Keep reading

Loading…

Something went wrong. Please refresh the page and/or try again.