News

Stampede2 (Sean Cunningham / TACC)

EECS-affiliated team break record for fastest deep learning training

Grad student Yang You, Prof. James Demmel and Prof. Kurt Keutzer, along with Prof. Cho-Jui Hsieh of UC Davis and Dr. Zhao Zhang of the Texas Advanced Computing Center (TACC), have created, in collaboration with researchers at NVIDIA, a new algorithm which enables them to harness the power of supercomputers to train a deep neural network (DNN) for image recognition at record speed. Deep learning researchers currently use trial-and-error to design new models, requiring them to run training processes tens or even hundreds of times for each model.  The team's effort efficiently used 1024 Skylake processors on the Stampede2 supercomputer at TACC to complete a 100-epoch ImageNet training with AlexNet in 11 minutes - the fastest time recorded to date.  Also, using 1600 Skylake processors, they bested Facebook's prior results by finishing a 90-epoch ImageNet training with ResNet-50 in 32 minutes and, for batch sizes above 20,000, their accuracy was much higher than Facebook's.   The group's breakthrough involved the development of the Layer-Wise Adaptive Rate Scaling (LARS) algorithm that is capable of distributing data efficiently to many processors to compute simultaneously using a larger-than-ever batch size (up to 32,000 items). The LARS algorithm was jointly developed with Nvidia. The findings show an alternative to the trend of using specialized hardware - either GPUs, Tensor Flow chips, FPGAs or other emerging architectures—for deep learning. The team wrote the code based on Caffe and utilized Intel-Caffe, which supports multi-node training. The results are published in Arxiv.

New Master of Cybersecurity degree now accepting applications

The School of Information (I School) is now accepting applications for its new, online Master of Information and Cybersecurity (MICS) program, also known as cybersecurity@berkeley.  MICS is an accredited program designed to train students with professional experience for a career in cybersecurity. Delivered online, MICS provides the technical skills and contextual knowledge students need to assume leadership positions in private sector technology companies as well as government and military organizations.  The program was developed in partnership with the College of Engineering and in collaboration with the Center for Long-Term Cybersecurity (CLTC).  A number of EECS faculty are involved with the CLTC, which seeks to create effective dialogue among industry, academia, policy makers, and practitioners around a future-oriented conceptualization of cybersecurity — what it could imply and mean for human beings, machines, and the societies that will depend on both.  The first application deadline is January 30, 2018, and the first cohort of students will begin classes in May 2018.

UC Berkeley ranks #3 in 2017 U.S. and global CSRankings

UC Berkeley is ranked #3 overall in the U.S. and global computer science rankings (CSRankings) for 2017.  CSRankings is designed as a more meaningful and transparent alternative to the US News and World Report computer science ranking system--which is entirely reputation-based and relies on surveys sent to department heads and directors of graduate studies.  The CSRankings system is entirely metrics-based: it weighs departments by their presence at the most prestigious publication venues.    Berkeley ranked in the top 10 in all 4 fields:  Theory (1), Artificial Intelligence (3), Systems (6) and Interdisciplinary Areas (6).  And of the 26 areas ranked, Berkeley made the top 10 in 11 of them: computer vision(2), robotics(2), machine learning and data mining(3), computer security(3), cryptography(3), design automation(3), operating systems(4), natural language processing(5), software engineering(6), algorithms & complexity(7), computer networks(8).

Embodied Intelligence raises $7M in seed round

Start-up Embodied Intelligence,  founded by Prof. Pieter Abbeel and his grad students Peter Chen, Rocky Duan, and Tianhao Zhang, raised $7M in a seed round yesterday led by venture capital firm Amplify Partners.  VC firms Lux Capital, SV Angels, FreeS, 11.2 Capital, and A. Capital also supplied capital.  Embodied Intelligence is building AI software to enable robots to learn tasks performed by the user via a virtual reality headset.  It claims existing robots will be compatible with the "robot brain," which would supplant coding scripts tailored to each task.  Embodied will use the seed capital to write its first robotics applications.

Bhat and Phadte (Laura A. Oda/Bay Area News Group)

Students help debunk fake news surrounding Texas shooting

EECS junior Rohan Phadte and fellow student Ash Bhat launched their Chrome browser extension, Botcheck.me, on Halloween and it is already proving invaluable.   The app determines whether news posts on Twitter likely came from real people or were generated by a bot.  When an armed gunman attacked the congregants of a Texas church this weekend, all legitmate news accounts agreed that neither race nor religion appeared to play a role.  But a barrage of bots immediately started spreading rumors that the shooter had recently converted to Islam or was a member of Antifa.   According to a simple random sample of 1,500 political propaganda Twitter bots the students posted on their site, #texaschurchmassacre was the bot world’s third favorite hashtag on Monday, after #maga and #antifa.

Students learn to think like hackers for 'cyberwar' course

CS students enrolled in CS 194, an experimental “cyberwar” course led by Prof. Doug Tygar,  have joined forces with the white hat hackers at HackerOne, a vulnerability coordination and bug bounty platform.  This is the first time that HackerOne--which connects hackers with tech companies, private businesses and federal agencies to hunt for vulnerabilities--has partnered with a university.  Students are gaining real-world cyberwar experience. “Unless students can learn to ‘think like a hacker,’ they will not be able to effectively defend systems” says Tygar.

BRETT training with VR

EECS-affiliated startup uses virtual reality to show robots how to perform

The start-up Embodied Intelligence and its founders, Prof. Pieter Abbeel and grad students Peter Chen, Rocky Duan, and Tianhao Zhang, are the focus of two news articles: one from the New York Times titled "A.I. Researchers Leave Elon Musk Lab to Begin Robotics Start-Up," and one from Berkeley News titled "Berkeley startup to train robots like puppets."  The start-up is backed by $7 million in funding from Amplify Partners and other investors and will specialize in complex algorithms that allow machines to learn new tasks on their own through extreme trial and error.  The researchers are augmenting the algorithms with a wide range of techniques, like using virtual reality tools to show a robot how to perform a task--translating the movements into digital data.  “With our advances in machine learning, we can write a piece of software once — machine learning code that enables the robot to learn — and then when the robot needs to be equipped with a new skill, we simply provide new data.” Abbeel explains.

Case studies in forward thinking: Pieter Abbeel, Claire Tomlin, Alexandre Bayen, Ken Goldberg, Ren Ng, and Ana Claudia Arias

Six EECS faculty are profiled in a Berkeley Engineering article titled "Case studies in forward thinking."  Pieter Abbeel's vision of the future is one of goal-oriented AI, where machines are learning responsibly.  Claire Tomlin envisions a future of airspace management, where intelligent robots can quickly and safely react to dynamic situations, and maybe even deliver packages on time.   Alexandre Bayen sees transit data trends, where data is used to reveal the previously unobservable.  Ken Goldberg envisions a future of dexterous robots, where machines work together with humans to refine their respective skills sand expertise.  Ren Ng's vision of the future is one where better optics--integrating both hardware and software--improve everything from computer vision and medical diagnostics to family photos and immersive entertainment.   Ana Claudia Arias sees a future which includes electronics and diagnostic equipment that fits the body of a patient and is capable of quickly producing high resolution images, all the while providing a more comfortable experience, particularly for children.

Pieter Abbeel, Sergey Levine & Chelsea Finn (Peter Earl McCollough)

Pieter Abbeel on building A.I. that can build A.I.

Prof. Pieter Abbeel is featured in a New York Times article titled "Building A.I. That Can Build A.I.," about how Google and others, in competition for a small pool of qualified researchers, are looking for automated ways to deal with a shortage of artificial intelligence experts.   The key might be to build algorithms that analyze the development of other algorithms, learning which methods are successful and which are not--leading to  more effective machine learning.  This could help companies build systems with artificial intelligence even if they don’t have extensive expertise in that area.  Abbeel and his team demonstrate techniques that could allow robots to learn new tasks based on what they have learned in the past. “Computers are going to invent the algorithms for us, essentially,” said  Abbeel. “Algorithms invented by computers can solve many, many problems very quickly — at least that is the hope.”

Schematic of a magnetic memory array

EECS-affiliated team develops new, ultrafast method for electrically controlling magnetism in certain metals

A UC Berkeley/UC Riverside research group that includes Prof. Jeffrey Bokor, Prof. Sayeef Salahuddin, postdoc Charles-Henri Lambert, postdoctoral fellow Jon Gorchon, and EE graduate student Akshay Pattabi have developed a new, ultrafast method for electrically controlling magnetism in certain metals, a breakthrough that could lead to greatly increased performance and more energy-efficient computer memory and processing technologies.  Their findings are published in both Science Advances (Vol. 3, No. 49, Nov. 3, 2017) under the title Ultrafast magnetization reversal by picosecond electrical pulses and Applied Physics Letters (Vol. III, No. 4, July 24, 2017) under the title Single shot ultrafast all optical magnetization switching of ferromagnetic Co/Pt multilayers.  “The development of a non-volatile memory that is as fast as charge-based random-access memories could dramatically improve performance and energy efficiency of computing devices,” says Bokor. “That motivated us to look for new ways to control magnetism in materials at much higher speeds than in today’s MRAM.”