时间:2025-04-04 05:26:10 来源:网络整理编辑:百科
Dr. Xiaofan (Fred) Jiang’s lab, at the Data Science Institute of Columbia University, has a sc
Dr. Xiaofan (Fred) Jiang’s lab, at the Data Science Institute of Columbia University, has a scenic view of the Hudson River and easy access to busy streets where he can test his latest invention — smart headphones that warn pedestrians of road dangers.
Small circuit boards sit on a gray table covered with mathematical equations written in pencil. They're specifically engineered for different versions of the prototype — the latest of which is a modified pair of $10 overhead headphones Jiang ordered from Amazon. The idea, he said, is to build parts that can one day be integrated into mass-market headphones.
The headphones were re-engineered with the custom circuit boards, as well as four extra microphones, meant to detect street sounds. That information is sent to the circuit board to extract useful information, and then it's transmitted to a custom smartphone app for AI analysis.
The app is trained to differentiate car sounds from background noise; calculate the distance and position cars relative to the headphone wearer; and alert them of surrounding dangers.
Jiang offered to start our day with a lab demo. Once I was finally able to attach one of the microphones to my uncooperative mock-neck collar, Steven Xia, the lab’s PhD research assistant, handed me his phone and instructed me to hit “start” on the app.
“Let’s hope it works,” Jiang joked. “What is it called — Murphy’s Law?”
Xia positioned himself at a 45-degree angle to my right and played sounds of a moving car from a speaker he was holding. No alerts from the headphones.
“I’m supposed to hear notifications, right?” I asked Xia, who proceeded to adjust the volume on his phone. Xia repositioned himself and continued playing car sounds. The headphones beeped, and the phone buzzed. A moving red dot on the app accurately showed me the simulated car’s position relative to where I stood.
Xia explained that the red dot had moved because the app interprets distance based on the volume of the car. The louder the car gets, the closer the car is.
“Right now, it’s about how the loudness is changing, right? But it’s not actually changing,” Jiang added. “This is really just better at showing the direction. We should go to the streets and do something more realistic.”
As we headed toward a street nearby, Jiang told me how he tested the headphones at four different locations, both urban and suburban, to experiment its efficacy in different settings.
“It’s funny because I drive an electric hybrid car,” Jiang added, noting that quiet electric cars and hybrids can sometimes be challenging for the system to detect. But he also mentioned how legislation in the EU requires hybrid and electric cars to generate artificial noise, and how others are advocating for cars to emit digital signals which his system can be modified to detect.
Noticing a loud generator near our destination, Jiang recommended that we pick a location that would minimize any unforeseeable disruptions. Xia suggested a place just across the street and around the corner, where he had tested the headphones before.
“Are we comfortable with jaywalking? With our system, you can be more comfortable doing that,” Jiang said sarcastically. “No, no, no. There’s one thing we try to reassure: We’re not trying to desensitize pedestrians’ attention. We do notencourage jaywalking.”
We settled at a location where a generator rumbled in the background. This time, I suggested that Xia put on the headphones so that I could observe. The red dot hovered around the screen, where the generator was located. “I think this is from that noise back there,” Xia said.
“Also the airplane,” Xia added as an airplane approached us overhead. The red dot bounced along the movement of the plane. Jiang noted to himself that the lab would need to sample and record more airplane sounds and label them as “not car” so the AI can learn to differentiate cars from airplanes.
“This is why I say we’re still about a year away from when we can transfer it to the university’s [venture capital partner]. When the scenario is ideal, it’s what we expect. But there are a lot of these random things — it has false positives,” Jiang said, noting that these roadside tests often worked better in suburban environments. “But this is something we need to solve. Urban is where the problem is.”
Jiang told me he had experimented with other options that would detect vehicles better, such as cameras and LiDAR technologies used by self-driving cars. “But they’re power hungry; we want to be able to power this with a cell phone battery,” he said. “And we discussed privacy as another problem.”
But he also mentioned the idea of a smart city: If in the future, cities are equipped with sensors that track every moving object, then the headphones will be much better at warning everybody of potential dangers.
A few cars drove by again, and the app worked perfectly those times.
“Every time we come out we have to think about how to improve this. Sorry this didn’t work out as well as I thought it would,” Jiang said as we walked back toward campus. “But maybe next year we’re going to meet up again.”
TopicsArtificial Intelligence
One of the most controversial power struggles in media comes to a close2025-04-04 04:47
祝一帆回應南通支雲 :對我的汙名化是想讓我社會性死亡2025-04-04 04:40
巴薩報警了!格子追平特雷澤蓋 法國隊史第4射手2025-04-04 04:39
曝巴薩尋槍看上C羅小弟 米蘭棄將或成哈蘭德備胎2025-04-04 03:50
Donald Trump's tangled web of Russian influence2025-04-04 03:48
西班牙VS希臘首發:拉莫斯領銜 莫拉塔托雷斯出戰2025-04-04 03:27
歐洲杯賠率:死亡組法德葡不降反升 荷蘭慘被看衰2025-04-04 02:57
意大利前瞻:欲延續首戰不敗 博努奇迎百場裏程碑2025-04-04 02:52
Visualizing July's astounding global temperature records2025-04-04 02:50
內蒙古媒體:內蒙古中優符合準入要求 就等新投資商2025-04-04 02:46
This 'sh*tpost' bot makes terrible memes so you don't have to2025-04-04 05:20
祝一帆回應打假球:為何給我三停卻不開除 就想把錢要回來2025-04-04 05:12
阿蘭年初報名中文培訓班 每天學4小時已能簡單交流書寫2025-04-04 05:10
國安迎來短暫假期下周一集中 4月6日返京休整再赴賽區2025-04-04 04:56
Nate Parker is finally thinking about the woman who accused him of rape2025-04-04 04:43
1V6!林加德賽後社媒曬神圖 疑似致敬伊涅斯塔2025-04-04 04:31
曝華夏外援圖雷有望轉會河南 或租借離隊減輕球隊負擔2025-04-04 04:29
保名成功 !北京中赫國安更名北京國安 完成中性化更名2025-04-04 04:20
Photos show the Blue Cut fire blazing a path of destruction in California2025-04-04 04:07
曼城拜仁PK ?德國雙核隊內鬥法 上帝視角對決MVP2025-04-04 02:49