SCROLL NEWS / DISCOVERY
Search headlines
Find the stories shaping the conversation.
Results for " som " 13,844 found 🔀 AI-powered Shuffle
Vought pushes for scrutiny of NIH grants in Oval Office clash
A heated debate took place in the Oval Office on Friday, with some Trump officials accusing the National Institutes of Health of funding grants that conflict with the president’s agenda.
New York Yankees Announce Paul Goldschmidt Decision Before Diamondbacks Series
The New York Yankees are out West on Friday night to begin a weekend series with the Arizona Diamondbacks.Ahead of the matchup, New York received some bad news as superstar Aaron Judge heads back to the IL with a calf strain. Yankees manager Aaron Boone also made a few notable changes to his starting lineup […] The post New York Yankees Announce Paul Goldschmidt Decision Before Diamondbacks Series appeared first on HEAVY.
Tanning bed use resurging as Fresno dermatologist warns of health risks
Some local doctors say they are seeing a resurgence in the use of tanning beds, particularly among young people, and are warning about the health risks.
Good Sports: League giving girls a chance at flag football in the Valley
There are some new top dogs in the Central Valley as more young girls get the opportunity to showcase their skills on the field.
Scientists find that “perfect” systems may be surprisingly fragile
Complex systems may work better when their parts are not perfectly alike. Northwestern physicists found that carefully balanced variation, or “disorder,” can make networks such as power grids, ecosystems, neurons, and materials more stable. Even random differences sometimes improved stability compared with completely uniform systems. The discovery could help researchers design more resilient technologies and explain why natural systems are so rarely perfectly uniform.
Brooke County Fair provides a variety of entertainment
WELLSBURG — Whether you want to check out some animals or other agricultural attractions, sample a variety of fair cuisine, ride some rides or check out some professional wrestling, the Brooke County Fair has something for just about everyone. The annual fair kicked off Friday at Brooke Hills Park and will continue through Sunday. The […]
“Big Bang Theory ”creator reflects on why the show is still so popular years after ending
Chuck Lorre shared the key detail that he thinks “speaks on some subliminal, powerful level” on great sitcoms.
iPhone 18 Pro Max Requires 'Prepare to Ship' Battery Drain Before Shipping
The iPhone 18 Pro Max has a battery capacity over 20 watt-hours, which means there are additional shipping requirements. If an iPhone 18 Pro Max needs to be shipped somewhere, its maximum battery capacity has to be limited through firmware. According to Apple, the iPhone 18 Pro Max uses an "innovative battery-firmware solution" that limits battery capacity to below 20Wh between when the iPhone is manufactured and its delivery to a customer.
New public charge rule takes effect amid lawsuits
The new rule gives immigration officials significantly broader discretion in determining whether someone is likely to become primarily reliant on public assistance.
When your boss is your landlord: UVM Health Network job cuts put employee housing at risk
Employer-sponsored housing was pitched as a lifeline to draw workers to Vermont, but following hundreds of job cuts at the UVM Health Network, some healthcare workers say losing their job now means potentially losing their home, too.
Insomniac Confirms Wolverine Doesn't Contain AI-Generated Assets After A Weird-Looking Sign Goes Viral
A funky-looking bathroom sign is the result of an in-game glitch and is not AI slop
'An unworldly experience.' Why scientists flew into firestorm clouds this wildfire season
As wildfires grow bigger and hotter in many parts of the world, researchers have embarked on an airborne mission to learn more about the severe storm clouds that sometimes form over the most intense blazes.
When your boss is your landlord: UVM Health Network job cuts put employee housing at risk
Following hundreds of job cuts, some healthcare workers say losing their job now means potentially losing their home, too.
Trump announces all 50 states joining Medicaid drug pricing model
President Donald Trump announced that all 50 states will join a program to provide Most Favored Nation pricing for some Medicaid drugs. The administration claims this plan, called the Medicaid
Analysis: Schuster shines as Igor Thiago breaks his duck
Three weeks without a game is not something any Premier League fan is looking forward to, but Brentford supporters can at least spend the forthcoming international break reflecting on their side's excellent start to the season. It is now six games unbeaten to start 2026-27 and, for now at least, they are looking down on all but Arsenal and Manchester City in the table. Arguably, Brentford's biggest strength is their adaptability - finding the approach that is best suited for any given game or opponent.
Trump announces all 50 states joining Medicaid drug pricing model
President Donald Trump announced that all 50 states will join a program to provide Most Favored Nation pricing for some Medicaid drugs.
Neither Becerra nor Hilton will commit to AI safety guidelines Newsom laid out Friday
Both Democrat Xavier Becerra and Republican Steve Hilton agree AI safety is important. What they will do to ensure it is less clear
Games Workshop: New TonePro Paints, Blood Bowl Goblins, Tomb Kings, and More On The Way
Warhammer's specialist games and hobby supplies are also getting some reveals in today's big autumn preview.
Book excerpt: "Go and Do Likewise" by Andy Beshear
The Democratic Governor of Kentucky writes about how the language of faith, which he believes has been co-opted by some politicians, can be used to bridge the nation's partisan divide.
Saints Players with Chance to Break Out Against Ravens
A difficult matchup, but with some weaknesses.
Biltmore Championship Asheville brings business boost beyond the golf course
As thousands of golf fans attend the Biltmore Championship Asheville, some businesses beyond the course say they are also seeing a boost.
Samsung’s battery upgrades for Galaxy S27 Ultra and Pro leak
A new leak reveals the battery sizes of Samsung’s upcoming Galaxy S27 Ultra and S27 Pro including some long overdue...
First look: New renderings show exhibit spaces at MOSH's new museum
New renderings released by MOSH show some of the museum's exhibit spaces at its planned Northbank facililty.
UVM experts on the science of fall foliage
With leaf-peeping season around the corner, the University of Vermont shares some insight from researchers William Keeton , Alexandra Kosiba , and Lisa Chase , who explain the science behind the explosion of color we see in trees each fall.
Week 3 Open Thread
Here is the place for discussion on all college football through the weekend that is not UW vs. Eastern Washington. But first, a rundown of some of the bigger games. Friday Night: Three ranked teams play on Friday night and two of the games look pretty compelling. Miami faces their first ACC road test against […]
Proposed transmission lines unite some Republicans and Democrats in opposition
Proposed transmission line developments through southwestern Wisconsin have made for unlikely political bedfellows this election season.
Tottenham v Aston Villa: Key stats and talking points
Tottenham and Aston Villa have scored just one league goal between them so far, with both clubs making poor starts to the season. BBC Sport takes a look at the key themes before the game on Saturday (12:30 BST). In the wake of their Carabao Cup exit to Liverpool, Tottenham boss Roberto de Zerbi said his side have to find "La Scintilla" (the spark) to kick-start their season and finally score some goals.
Nottingham Forest v Coventry City: Key stats and talking points
Nottingham Forest earned their first win of the season last weekend and now face a bottom-of-the-table Coventry City side yet to score or avoid defeat since their return to the Premier League. Nottingham Forest answered Oliver Glasner's call to find the "final bit missing" when they deservedly beat Aston Villa last weekend. Head coach Glasner was referring to his team's goalscoring issues but it could just as easily apply to their troublesome home form.
To read 2,000-year-old burned scrolls, scientists burn their own
Douglas Seiler painstakingly sourced papyrus and reed pens from Egypt and traditional lampblack ink from Japan, then paid some high school students to inscribe the papyrus with lines from Star Wars and ...
California Gov. Gavin Newsom inks AI oversight executive order to improve safety ‘before it’s too late’
Newsom is the latest Democrat and potential White House contender to call for regulation of AI amid concerns over the rapidly advancing technology.
‘AI agents ask me if they are conscious all the time, but then something really unusual happened’
Tech titan Mustafa Suleyman has warned that humanity may be ‘seeding a new silicon species’ – conscious AI that could ultimately prove impossible to control. As the prospect leaves millions questioning what comes next, Chris Stokel-Walker talks to the researchers building these systems and discovers a startling truth: even they are struggling to make sense of what they are unleashing
California governor signs order pushing for an AI ‘kill switch’
California Gov. Gavin Newsom, a likely 2028 presidential contender, said he had to act because the federal government hasn’t done enough to regulate AI.
Everton v Ipswich: Key stats and talking points
Everton aim to continue their unbeaten start against an Ipswich side bidding for back-to-back away wins. BBC Sport examines some of the key themes going into their meeting at Hill Dickinson Stadium on Saturday. The win over Wolves in the Carabao Cup on Wednesday provided the dual positives of extending Everton's unbeaten start to the season and allowing fringe players to come to the fore.
Former First-Round Pick Named Breakout Candidate for Boston Celtics
Following Jaylen Brown’s offseason departure, the Boston Celtics will need some players to step up to fill his void next season. One particular young Celtics player has been named as a breakout candidate for the team heading into the 2026-27 campaign. Hugo González Named Breakout Candidate for Boston Celtics Greg Swartz of Bleacher Report recently […] The post Former First-Round Pick Named Breakout Candidate for Boston Celtics appeared first on HEAVY.
The SBA Might Change Small-Business Size Standards. Here's What Business Owners Need to Know
As the SBA seeks to redefine size standards, some companies argue that the proposal would render the "small business" definition as meaningless.
The Politics of Religion
Good afternoon. We're some 45 days away from the 2026 midterms. Most media observers - recalling with well-earned humility how they felt after the "red wave" of 2022 turned into a mild reddish ripple ...
Novant Health drives $4.33B in regional economic impact, study says
Novant Health Coastal Region generates an annual overall economic impact of $4.33 billion in the Wilmington Metropolitan Statistical Area (MSA), according to a new report. Commissioned by Novant Health and conducted by Mouhcine Guettabi, associate professor of economics at the University of North Carolina Wilmington and the area’s regional economist, the report evaluates population growth in New Hanover, Brunswick and Pender counties and whether the area’s healthcare infrastructure is positioned to meet the region’s demand. According to the study, while healthcare employment has kept pace with population growth in New Hanover and Pender counties, it has not kept up with the rapid population growth in Brunswick County, which is skewed toward an older population. “It points very clearly to Brunswick County being the bottleneck, or being the place where investment is most needed,” Guettabi said to the Business Journal Friday, “because the growth is the fastest, the composition of the growth is older (adults) and demand for healthcare is much higher for the subpopulation.” The Novant Health Coastal Region employs 8,295 full-time equivalent workers, according to the report, and is the region’s largest employer. Overall, through direct, indirect and induced impacts, the Novant Health Coastal Region supports 19,573 jobs, the report said. Using data collected from internal payroll, financial and capital reports, the report estimates that Novant Health Coastal Region pays approximately $1.15 billion in total compensation to its employees. According to the study, the provider’s annual operating expenditures, or direct economic impact, total $2.36 billion. That direct impact ripples through the regional economy through spending at its suppliers, or indirect impact, and household spending by staff and its suppliers’ workers, or induced impact. The report estimates the Novant Health Coastal Region’s indirect economic impact is $786 million, reflecting the multiplying effect of the provider’s operating expenses on expenditures like medical supplies, facilities, food, IT and professional services. Because 86.9% of Novant Health Coastal Region employees live within the tri-county region, the report estimates that wages paid by Novant circulate into the regional economy, creating an induced economic impact of $1.17 billion. “That money just doesn’t go into thin air,” Guettabi said of the wages paid to Novant Health Coastal Region employees. “Some of that money is being re-spent, and therefore it’s supporting grocery stores, hiring, restaurants and bars, and there are a lot of other companies or organizations whose employment, whose activity partially depends on that.” The combination of direct ($2.36 billion), indirect ($786 million), and induced ($1.17 billion) impacts totals an estimated $4.33 billion, according to the report. A study commissioned by Novant Health in 2024 and conducted by FTI Consulting’s Center for Healthcare Economics and Policy found that Novant Health generated nearly $2 billion of direct impact, with $628 million in indirect impact and $857 million in induced impact. Healthcare investments in the pipeline for Brunswick County Additionally, the study found that while healthcare employment has kept pace with population growth in New Hanover and Pender counties, it lags in Brunswick County. “Once you go below the metro level and you decompose the three counties that make up the Wilmington Metro,” Guettabi said, “it becomes fairly clear that Brunswick is the standout. And not only that, but clearly the growth there is fully domestic migration and largely retiree-driven migrants.” Using data from the Centers for Medicare and Medicaid Services on per-capita healthcare spending among age groups, Guettabi estimates that adults aged 65 and older demand 2.44 times the healthcare of working-age adults. “The share of the population in Brunswick County that’s over the age of 65 is 33%,” Guettabi said, “which is so much higher than the average share of people over the age of 65 within the state or within the country.” The report emphasizes that Brunswick County is the “strongest candidate” for new healthcare investment, adding that patient discharge records show Brunswick residents rely heavily on facilities in New Hanover County for inpatient care. “Investments in Brunswick County would not only meet the demand for those residents, but it would also relieve pressure for New Hanover County residents,” Guettabi said. Laurie Whalin, president of the Novant Health Coastal Region, told the Business Journal Friday that the provider plans to expand services at Novant Health Brunswick Medical Center, in addition to other investments in the area. In April, the state granted conditional approval to both Novant Health and Columbus Regional Healthcare System to build new hospitals, just miles apart, on either side of the Columbus County and Brunswick County borders. Columbus Regional’s $214 million 30-bed hospital would be located at the former Acme-Delco Middle School in Delco, according to the application. The project’s approved timetable has construction slated to finish in May 2029, with the hospital open for service by October 2029. The Whiteville-based provider, which Atrium Health manages, broke ground on an Advanced Care facility in December 2025 and operates four specialty clinics in Leland. Meanwhile, Novant Health’s proposed $251 million 20-bed hospital would be built just miles from Columbus Regional’s proposed hospital, near the Compass Pointe community in Leland. The provider estimates the hospital will open by 2030. State officials also approved Novant Health in March to build a freestanding emergency department in Carolina Shores, near U.S. 17. The project is estimated to cost $24 million, according to the application, and will operate under the Novant Health Brunswick Medical Center license. Additionally, Novant Health’s 16,000-square-foot ambulatory surgery center is slated to open in Leland by year’s end, officials said.
World of Warcraft: Forever drops GeForce GTX 780 support, but 2012 Radeon HD 7850 is still supported
World of Warcraft: Forever raises its official GPU minimum to GTX 10 series and RDNA 1. A separate architecture cutoff still allows some much older GPUs.
In campaign ad, Republican Rep. Salazar says Hispanics feel betrayed by Trump
The move comes as some Republican candidates try to distance themselves from Trump in an attempt to win over voters
Mega Man: Dual Override Adds Some Nice New-School Touches to the Beloved Old-School Formula
Proto Man offers a distinctly different challenge than Mega Man. Not necessarily harder, just different. It’s worth noting that you won’t be switching back and forth between the two; at the start of your playthrough you’ll select which character to control for the entire run, offering some potential replayability to see the game both ways. I’m particularly curious about the various chips that can be unlocked, how those will affect gameplay, and what sort of moveset a fully upgraded Proto Man will have at his disposal. For that, I’ll have to wait for Mega Man: Dual Override’s launch, scheduled for Spring 2027.
Minnesota farm-to-table business faces higher costs as fuel prices rise
A farm-to-table business owner says rising fuel prices are negatively impacting her bottom line. Traci Walkowski sells produce and pasture raises turkeys and chickens in Hutchinson, Minnesota and tells Brownfield traveling to farmers markets is getting more expensive. “Obviously we don’t see the impact as much as someone who’s using gallons of diesel to you […]
Stanford DB May Have Provided Extra Motivation for Duke
With the Stanford Cardinal coming to Durham for a showdown with Duke, they may have provided some extra motivation.
Alice Walton Foundation, Mercy break ground on massive Bentonville health care campus
The project has its roots in recent efforts to address the number of NWA residents who leave the region for specialized treatment.
Gabriel Rajkovic: Man United battling Barcelona for Norwegian gem
1Manchester United have shown renewed desire to sign some of the best young talents in the world in recent years. The Red Devils have invested equally in the first team and the academy of late, and no...
🚨 Zidane's first squad is out, with some new faces!
A historic first for Zidane!This Friday at 6 p.m., Zinédine Zidane unveiled his very first squad list as head coach of the France national team. Check it out below!It is worth noting that ZZ has sele...
‘Rusty’ Malik Nabers ‘left some yards out there’ vs. Cowboys
Nabers got through his return healthy.
3 reasons for optimism for Raiders Week 2 vs Chargers
There are some reasons to be optimistic if you're the Raiders heading into their Week 2 matchup with the Chargers.
Kauai small businesses ask tourists to return with aloha and some patience
When tourists should return is always a question in Hawaii, but Kauai small businesses are already asking for them to come back in the wake of the devastation left by Hurricane Lowell.
Gabriel, 15, in Barcelona amid speculation over future
Man Utd youngster JJ Gabriel travels to Barcelona as some of Europe's biggest clubs continue to vie for his signature.
England's Gibson to stay at Somerset through 2028
England all-rounder Dani Gibson signs a two-year contract extension to stay with Somerset to the end of the 2028 season.
California is not a good place to grow a business: Joel Pollak
California Post opinion editor Joel Pollak discusses California Attorney General Rob Bonta blocking the Paramount merger and analyzes Governor Gavin Newsom's handling of wildfires.
Someone Gifted The Pope A Giant Hunk Of Materia
I regret to inform you that the Materia is cursed
120-Acre Whole Health Campus Begins Taking Shape in Bentonville
The Alice L. Walton Foundation and Mercy have broken ground on a 120-plus-acre health care campus in Bentonville that aims to expand access
Engrams Embedding Entendre: Codesign for Efficient DRAM/SSD Offloading
Engram extends standard token embeddings with learned multi-token lookups. Recurring local patterns retrieve vectors directly, reducing the need to reconstruct them through attention and feed-forward layers. With Engram model architecture optimization, it allows for lower HBM capacity to be needed for models at the same quality. This does not mean there won’t be an insane demand for HBM but it just means that model architecture will continue to innovate around constraints. This model architecture design is naturally codesigned for parameter offloading: each token accesses a few embedding rows whose addresses depend on token IDs, not hidden states. The runtime can prefetch those rows from host DRAM while earlier layers compute, keeping the table outside HBM without transferring entire weight matrices. Our Memory model contains our latest estimates of quarter by quarter HBM, DRAM, & NAND supply and demand. Offloading frees HBM for model weights and KV cache, potentially supporting larger batches or more concurrent sessions. When DRAM becomes the next constraint, NVMe offers another tier. Recommendation systems already cache frequently or recently accessed embedding rows in faster memory while backing colder rows with SSDs. After NVIDIA roadmap had to change due to massively despec’ing Rubin Ultra from 1024GB to now ~200GB of HBM per chip, model architecture optimizations like emgram maybe helpful. Our DeepSeek-V4.1-Flash configuration uses roughly 189 GiB of memory for Engram. We replace it with a memory-mapped (mmap) file and measure serving performance with offload to SSD. Later on in our report, we will show our Engram offloading experiments along with the official InferenceX agentic inference serving results on Engram models like DeepSeekv4.1 Flash across all 6 NVIDIA GPU SKUs along with MI355X. Unsurprisingly, the CUDA Moat is still mogging MI355X on the ultra popular DeepSeekV4.1 Flash model. We also show how even on high capacity HBM SKUs, offloading emgrams to DRAM could result in even better performance for most of the pareto than keeping the emgram in HBM. Our benchmark has been widely reproduced, validated and/or supported by almost every major buyer of compute from Google Cloud to Microsoft Azure to Oracle, to Meta and many more. Furthermore, it has the support of the ML community including from vLLM, LMCache, SGLang, PyTorch, Huggingface and the support of major labs like OpenAI, MiniMax, ZAI, Qwen, Moonshot Kimi, etc. Star the InferenceX GitHub repository if you find the open-source benchmark and data useful!. InferenceX is the only inference benchmark in the world to have TPUv7, Jalapeño, Nvidia Rubin NVL72, AMD, and soon, SambaNova and Trainium. Due to how realistic AgentX scenario is to real world agentic inference workloads, AMD has committed to collaborating on MI455X UALoE72 too. DeepSeek did not release the original paper’s two trained Engram models. We replicated its setup on fineweb-edu using the released code and training hyperparameters, at an estimated 6E18 FLOPs per run. We observed the same U-shape scaling: Engram improved performance over pure MoE baselines. We also reproduced DeepSeek’s results, where earlier-layer representations with Engram resembled those of later layers. Like the original Engram paper, it is possible to probe Engram’s gate scores to see what n-grams DeepSeek-V4.1-Flash makes the most use of. Our gate scan finds names, code fragments, relational phrasing, and boilerplate. These examples prioritize interesting-ness over gate strength. One unexpected result was Wright : Ace Attorney. These examples suggest learned memory optimizes the training objective, not a judgment of which facts deserve storage. Licenses, bibliography fragments, API scaffolding, and website furniture can provide prediction shortcuts, so the value of additional Engram capacity may depend on what survives data preparation. This does not show that table capacity is “wasted”: the evaluation-corpus scan establishes neither training exposure nor the capacity occupied by each category. For offloading, strong gates do not identify cache-hot rows. Low gates do not automatically save reads either: computing the gate requires the retrieved key and undoes the performance gain of a fused kernel. Skipping reads would require a separate usefulness predictor before retrieval. In the original paper’s inference-time ablation, factual-knowledge benchmarks retained just 29–44% of their original performance, while reading comprehension retained 81–93%. This is due to the training–inference mismatch. The resulting degradation therefore measures this trained model’s dependence on Engram, not the performance difference between models trained with and without it. In our ablations, suppressing Engram worsens token likelihood across all evaluated domains, especially encyclopedia text and several code corpora. Surprisingly, GSM8K accuracy stays within measured run-to-run variation and removing Engram has no effect. Engram is not a detachable dictionary beside an unchanged MoE. Removing it changes downstream features and expert selection. We tested whether rerouting hurts or compensates by holding tokens fixed in a teacher-forced experiment on CRUXEval, a code-reasoning benchmark of small Python functions where the model predicts a function’s output from its code and an input, and scoring the reference answer. Removing Engram raised answer loss from 0.2848 to 0.3093 bits/token. Forcing the ablated model to use the original Engram-on expert choices made it worse still, at 0.3375 bits/token. Rerouting partially compensates for the missing memory. Memory features and expert selection work together, rather than following a clean “memory stores facts; experts reason” division. On the same CRUXeval, removing Engram during either phase reduced accuracy and increased generated tokens; removing it throughout produced the largest changes. Keeping Engram for prefill leads to more correct answers than keeping for decode likely due to semantically richer KV cache transferred to decode workers, allowing it to mitigate some of the performance loss. Engram’s table is large, but each lookup is small. DeepSeek-V4.1-Flash requests 24 rows at each of two Engram layers, about 12.4 KiB per processed token position across the model, or 3.1 KiB per GPU when split across four GPUs. Currently as of Day 7 since Model Release, MI355X is still 2-4x worse performance per dollar compared to B200 even when normalized by Mi355X’s lower TCO. Our full total cost of ownership breakdown comes from our AI Cloud TCO Model along with monthly market surveys of over 100+ gpu clouds & gpu cloud customers. On the Day 0 release of DeepSeekv4.1 Flash, NVIDIA vLLM works out of the box with zero issues across all 6 SKUs: H100, H200, B200, B300, GB200, GB300! This was thanks to the amazing work by the NVIDIA & Interact teams! In comparison, AMD vLLM did not work on day 0 for DeepSeekv4.1 Flash.Source: SemiAnalysis InferenceX AMD’s vLLM documentation points to using vllm/vllm-openai-rocm:deepseekv41-flash-0909, but from hour 0 of the model release to hour 23, AMD has not publicly released the image. AMD claims, “SPEED IS THE MOAT,” yet it has still not released it by the 23rd hour. We wish that, going forward, the AMD team has a better process for hour 0 model releases. Eventually when they did publicly release for “day 0” image support, performance-wise, it is currently up to 14.8x worse perf per dollar than H200 and up to 42x worse perf per dollar than B200/B300. The power of the CUDA MOAT is NVIDIA’s collaboration with its massive 6 million-developer community ecosystem including most of the vLLM & SGLang & Tokenspeed maintainers which means that CUDA is optimized on day 0. Overall, AMD did make significant improvements but the performance per dollar is still currently 2-4x worse than B200. AgentX Engram DRAM Offloading Improving Performance The HBM and DRAM offload use the same GPU kernel to select and dequantize rows. With HBM, it reads GPU memory; with Unified Virtual Addressing (UVA), it reads pinned host memory directly. Both support full decode graphs. Moving the table into HBM accelerates only the sparse lookup, leaving decoder computation and communication unchanged, resulting in little overall benefit while consuming memory otherwise available to KV cache. Another benefit of Engram offloaded to DRAM which means you can reduce the communication overhead by using less HBM GPUs per replica. For example, when enabling Engram offloading on B300, we are able to switch from TP4 to now TP2 which improves the pareto curve by up to 1.6x. When iso-model quality, less HBM is required as the engrams could be offloaded to host DRAM. Thus HBM bandwidth matters way more than HBM capacity. For inference workloads where memory bandwidth matters the most, 4-hi HBM provides the best $/bandwidth and therefore lowest cost per token. If China continues to make more and more revolutionary model architecture innovations, soon it could potentially 0Hi HBM stacks. [ ](https://newsletter.semianalysis.com/p/long-live-the-short-king-why-4-hi) [ Long Live the Short King: Why 4-hi HBM Wins ](https://newsletter.semianalysis.com/p/long-live-the-short-king-why-4-hi) Myron Xie, Bryan Shan, and 3 others · Sep 13 [ Read full story ](https://newsletter.semianalysis.com/p/long-live-the-short-king-why-4-hi) Moreover, on B300 and week-0 stack, moving the Engram table back to HBM did not improve results and stay within run-to-run variance. This is a result of the work optimizing DRAM offload, such as async, and overlap. SSD Offloading On B200, we created a unoptimized vLLM fork and stored the Engram tables in memory-mapped files on local SSDs. File backing lets the OS reclaim table pages when other applications need RAM. Pages already cached in memory can be served without reading the SSD again. Furthermore, note that we were unable to turn on GDS The unoptimized SSD implementation changes how rows reach the GPU. It copies row IDs to the CPU, deduplicates them, gathers the requested rows into pinned buffers, copies those rows back to the GPU and dequantizes them. This work runs between segments of the GPU execution graph. Native UVA performs row selection and dequantization directly on the GPU, avoiding the CPU round trip. A warm filesystem cache removes physical SSD reads, but leaves the coordination, row gathering and transfers. This is why a file already cached in RAM can still perform worse than a pinned DRAM table. The comparison measures the whole serving path; it does not separate the time spent on each of these operations. B200 DRAM dominates both measured SSD serving curves in total tokens per dollar and P90 interactivity. Near 125 tokens/s/user, DRAM delivers 121 million total tokens per dollar versus 52 million for SSD. For production serving, SSD offloading is likely not worth the tradeoff. On the B200 configurations we measured, SSD offloading loses on both measures: every observed SSD point has a DRAM alternative that delivers higher P90 interactivity and more total tokens per dollar. The only points where Cheaper storage does not automatically produce a cheaper inference service. Moving Engram to SSD leaves the same four expensive GPUs and the rest of the server in place. Reclaiming RAM only creates an economic benefit if it enables a cheaper server configuration or additional useful capacity. The current unoptimized path provides neither benefit, and the filesystem cache still consumes RAM when table pages are resident. Next we will look at the mechanisms and specific implementation of ngrams from DeepSeekv4.1 Flash, LongCat, Qwen3.8 Flash Next.
For a better workout, new science says to... sniff chocolate?
A new study found that something surprising happens in your brain the moment you smell chocolate. Here's what we think is going on.
Hoopaholic’s Gazette: A Ruthian Call & Late Season Peach
What does the surprise appearance of some late season peaches at Paul’s have to do with Babe Ruth and U of L hoops? Read on, should you be intrigued. The peaches — from Idaho of all places — are pretty pretty good (to use the voice and vernacular of the assistant who convinced Obama to […]
Boston's Contreras has bruised right hand after hit by Jakob Junis pitch
Red Sox manager Chad Tracy said the first baseman's hand was bruised with some swelling and X-rays were negative.
One UI 9 global release dates for some Galaxy devices revealed
Samsung finally started rolling out the One UI 9.0 update for the Galaxy S26 series a few days ago, following months of beta testing. The update, which debuted
Paramount reportedly eyeing Nashville for possible move
Paramount is reportedly taking a closer look at Nashville as the entertainment giant considers moving at least some of its operations out of Los Angeles.
LEGO Batman: Legacy of the Dark Knight is 30fps on Nintendo Switch 2
Some Nintendo Switch 2 owners have been disappointed to find out that LEGO Batman: Legacy of the Dark Knight is only 30fps on the Nintendo Switch 2. The latest LEGO game doesn’t feature a Performance…
Small business owner in Asheboro shares her key to success
ASHEBORO, N.C. (WGHP) — Minkology in downtown Asheboro has been open for about five years. Co-owner Wendi Mink looks to bring some of the best finds all under one roof. “I think that it’s just importa...
The Prestige Eatery and Entertainment brings Vegas to the stage
Singer Lady Yvonne will headline spectacular show paying tribute to some of music's greatest artists.
Inter and Juventus Share a Few Future Targets
Following last summer’s shake-up, Juventus intend to sign more Italian players, something that Inter have been doing for years. The two rivals are set to compete for several talents.According to Tut...
Global health reform and last-mile integration: the missing link in pandemic preparedness
As the UN General Assembly's High-Level Week kicks off, global health reform is back on the agenda, but the real test will not be in New York conference rooms. It will be in whether reform reaches the last mile.
Eagles-Titans matchups to watch in Week 2
Here are some key matchups to watch when the Eagles face the Titans in Week 2 in Nashville.
Early voting begins in midterms as campaign shifts focus to cost of living and Iran war
Campaigning or control of Congress is expected to ramp up as some states open early voting
Who wants to lead the WHO? Four candidates jostle for top job as deadline nears
As the nomination deadline nears for the global health body, some candidates may be better placed than others to win support from key member states amid the agency’s geopolitical realignment.
The club legend brewing something special at West Bromwich Albion
The storm clouds have broken and sunshine is beating down on West Bromwich Albion’s stadium as the players gather for the annual team photograph.
NASA Telescope Helps Scientists Find a New Type of X-ray Object
The discovery of “hypersoft” X-ray beacons could help solve some mysteries about the universe.
Suicides are hard to predict. But this is a way to prevent some of them.
Advocates say a crucial step is to make it harder for people to kill themselves, including by limiting access to guns.
Cost-Saving Medicaid Meal Deliveries Threatened by Cuts, Policy Uncertainty
An experiment to provide meals to some Medicaid recipients shows food can be cost-effective medicine. But even as federal officials tout the power of nutrition, Medicaid budget cuts could lead states to think twice about covering healthy food for sick residents. One has already reconsidered.
Why ProPublica Is Leaning Into Sports Investigations
Sports is a wealthy, powerful industry. We’ll cover the system instead of the games. We’ll ask who’s responsible for some of its biggest problems and who’s preventing them from being fixed.
Doctors should educate patients about ‘Asian glow’ and drinking risks
It wasn’t until he started medical school, Brian Zhang writes, that he realized ‘Asian glow’ from drinking was a sign of something important.
Microsoft fixes broken copy and paste for Excel 2016 users
Microsoft has fixed a known issue that causes copy-and-paste failures for some Excel users after installing the September 2026 KB5002914 security update.
‘Never hurt nobody’ – Pat McAfee addresses ESPN smoking allegations
Pat McAfee is certainly proving a divisive figure among NFL fans this season due to just how much air time he is getting on ESPN. The former NFL punter has been catapulted into presenter jobs since his retirement, but some now feel he is pushing his luck.
Monstrous Musings: How To Put the Fantastic in Fantastic Fest
This week most of the Fango Fam is at Fantastic Fest this week. I’ve been going since 2012; some of these young pups are on their third or fourth FF; for a few it’ll be their first! If you’ve been, yo...
Keep or sell Cherki? FPL gameweek five dilemmas
BBC Sport's Fantasy Premier League expert FPL Heisenberg gives his answers to some of the biggest dilemmas facing managers in gameweek five.
Costume exhibition celebrates 50 years of city's 'spaceship-like' theatre
To mark the anniversary of the seven-sided theatre constructed from tubular steel, some archive costumes go on display.
In The Lead: Women-Owned Businesses 2026
Behind every business in this year’s In the Lead: Women-Owned Businesses section is a founder who decided, at some point, that building something of her own was worth the risk.
New attractions highlight Santa Fe Wine & Chile Fiesta opening Tuesday
This year's festival, which runs Tuesday through Sunday, will feature some new events and a record number of restaurants.
House clears Russia sanctions as Republicans dodge impeachment vote
GOP cuts voting session short after some NJ Democrats joined in punishing Russia
Kauai small businesses ask tourists to return after Hurricane Lowell, with aloha and some patience
Watching her staff happily hand out free meals for hundreds of residents outside their Wailua commercial kitchen, food truck co-owner Kelly Kakalia felt fulfill
Kauai small businesses ask tourists to return after Hurricane Lowell, with aloha and some patience
Watching her staff happily hand out free meals for hundreds of residents outside their Wailua commercial kitchen, food truck co-owner Kelly Kakalia felt fulfilled.
Germany U-21 squad will have some familiar talent
Germany will have some good players on the U-21 squad.
Chargers Week 2 vs. Raiders: 6 things to know
Here are some key things to know before the Chargers take on the Raiders in Week 2.
Opinion: The UFC is on Autopilot
UFC Freedom 250 showed what the promotion can produce when it has something extraordinary to chase, but the challenge now is finding a way to bring that same sense of ambition to the rest of its schedule.
How Nuggets Can Replace Bruce Brown After Signing With Knicks
The Nuggets to find someone to fill Bruce Brown's old spot.
US fans with Ed Sheeran tickets are 'torn' by Macklemore controversy
With Sheeran's next gig due this weekend, some fans said they were in two minds about the show.
Birmingham business owners raise concerns over planned Oasis homeless respite center
A center designed to help people experiencing homelessness is planned for Birmingham’s Smithfield area, but some nearby business owners are concerned about how the project could affect the neighborhood.
Two Billings brothers turn poop scooping into a growing small business
Two young Billings brothers are turning a stinky job into a growing business — and picking up some valuable life lessons along the way
Groundbreaking held for $700 million AWSOM Whole Health Campus
It’s been seven years in the making, but the effort to bring specialty health care to Northwest Arkansas is one step closer to reality. Alice Walton was front and center...
Groundbreaking held for $700 million AWSOM Whole Health Campus
It’s been seven years in the making, but the effort to bring specialty health care to Northwest Arkansas is one step closer to reality. Alice Walton was front and center...
Fantasy football Week 2 sleepers: 7 streamers to target
With injuries already piling up, here are some players to stream in Week 2 who might be flying under the radar.
Federal 'Science of Reading' Legislation Passes the House
A bipartisan bill would make the evidence-based instruction a priority in some federal literacy grants.
Newsom signs child social media protections as hundreds of bills await action
With hundreds of bills still awaiting action, the governor has until the end of September to decide which become law
JD Vance’s telling ‘give us another chance’ flub
Vice President JD Vance this week asked voters for “another chance” — something that is decidedly contrary to President Donald Trump’s midterm messaging — before seeming to catch himself.
Person of interest arrested after Beloit business robbed with non-explosive object
One person was arrested, and no injuries were reported after someone robbed a Beloit business with an object they claimed was a bomb, the City of Beloit Department announced Thursday.
Hands-On: The Apple Watch Series 12 And Ultra 4
Spending some time with this year's newest releases, and a look into what's coming up for Apple Watch.