#scaling laws

[frank-olivier]

Deep Learning, Deconstructed: A Physics-Informed Perspective on AI’s Inner Workings

Dr. Yasaman Bahri’s seminar offers a profound glimpse into the complexities of deep learning, merging empirical successes with theoretical foundations. Dr. Bahri’s distinct background, weaving together statistical physics, machine learning, and condensed matter physics, uniquely positions her to dissect the intricacies of deep neural networks. Her journey from a physics-centric PhD at UC Berkeley, influenced by computer science seminars, exemplifies the burgeoning synergy between physics and machine learning, underscoring the value of interdisciplinary approaches in elucidating deep learning’s mysteries.

At the heart of Dr. Bahri’s research lies the intriguing equivalence between neural networks and Gaussian processes in the infinite width limit, facilitated by the Central Limit Theorem. This theorem, by implying that the distribution of outputs from a neural network will approach a Gaussian distribution as the width of the network increases, provides a probabilistic framework for understanding neural network behavior. The derivation of Gaussian processes from various neural network architectures not only yields state-of-the-art kernels but also sheds light on the dynamics of optimization, enabling more precise predictions of model performance.

The discussion on scaling laws is multifaceted, encompassing empirical observations, theoretical underpinnings, and the intricate dance between model size, computational resources, and the volume of training data. While model quality often improves monotonically with these factors, reaching a point of diminishing returns, understanding these dynamics is crucial for efficient model design. Interestingly, the strategic selection of data emerges as a critical factor in surpassing the limitations imposed by power-law scaling, though this approach also presents challenges, including the risk of introducing biases and the need for domain-specific strategies.

As the field of deep learning continues to evolve, Dr. Bahri’s work serves as a beacon, illuminating the path forward. The imperative for interdisciplinary collaboration, combining the rigor of physics with the adaptability of machine learning, cannot be overstated. Moreover, the pursuit of personalized scaling laws, tailored to the unique characteristics of each problem domain, promises to revolutionize model efficiency. As researchers and practitioners navigate this complex landscape, they are left to ponder: What unforeseen synergies await discovery at the intersection of physics and deep learning, and how might these transform the future of artificial intelligence?

Yasaman Bahri: A First-Principle Approach to Understanding Deep Learning (DDPS Webinar, Lawrence Livermore National Laboratory, November 2024)

Sunday, November 24, 2024

[starry-bi-sky]

bruce and danny being fuckign nerds together,,,, they are being the BIGGEST nerds. geeks. if you will

these losers are color-coding the most inane bullshit. they are making diagrams for things you've never even thought of. they are having the time of their lives

"what are you two doing?"

Danny, sitting criss-cross on a table, hunched over a spread of papers and a bunch of different jello cups, his back is gonna hurt SO much: color-coding jello

Bruce, sitting in a nearby chair, also criss-cross, scribbling on a graph paper: hm [agreeing]

Alfred, already exasperated and SO fond: may i ask why? and on what parameters?

Danny: we're basing it off which flavors are the most mentally stimulating and for which subjects :}

Alfred, SO fond: ah. i see.

Danny, snapping his head over to Bruce and leaning over: wh- no-- no. Buzz, I told you: lemon-flavored jello stays strictly in the 'smelling salts' category--

Bruce, still writing on the graph paper: mn. no.

Danny, nearly sprawled across his back, faux-outraged: strawberry is NOT good for math-- you fucken HEATHEN--! Give me that pen!

Bruce, did that solely to rile up Danny, now trying not to smile: hnm.

[thisisadecisionimayregret]

Local politics is so important and you may think "it only impacts people in my city/county/whatever" but it can have much wider impacts

Like a concrete example of this is that in Pennsylvania, local laws in Philly, Pittsburgh, and Allegheny required that companies give paid sick leave to all employees — part time and seasonal, not just full time employees. And now, some companies (including the one I work for) decided that it was easier to make one policy for the whole state of PA that followed all the local laws, instead of changing the policy based on city/county.

So what that means concretely is that now, bc these local laws got passed requiring employees get paid sick leave, everyone else in the state also got paid sick leave even though they didn't live in one of the three places that passed those laws. (well, at least everyone working for the companies with state-wide policies)

Paid sick leave is not a small thing. Being able to call out sick from work and still get paid is huge, especially if you're someone living paycheck to paycheck.

And it only took 3 local laws getting passed to make a change impacting the entire state.

[nimudae]

[Heart Scales AU] First Contact 🧜‍♂️👒🧙‍♂️🐯

Happy mermay! Starting my first AU comic a year after the original sketch, I'll do my best to see this casual urban fantasy story through 💪

[Ko-fi]

[arabdoll]

[ridaine]

A little Freyluviel doodle between comms... for morale.

(Aluviel belongs to @cerylune)

[th3-c0ll3ct3r]

WAKE UP BITCHES ISKALL DROPPED AND IMMA EVALUATE IT-

Especially considering I was never a fan of him in the first place I will have no bias in this horse race

Video:

The entire video genuinely sounds like a more constructive Dream allegations video minus the detective outfit and 2hrs of rambling and a serious lack of evidence due to privacy reasons which kind of, so lightly sound like an excuse

He claims that when he was alerted to these allegations, he was given a 1hr and 30 minutes deadline to produce proof to the Hermits he didn't do anything

He then contact the police and a lawyer

Girl we are going to pause right here because stunning that you contacted the police and a lawyer but if you didn't do the things that you're alleged or doing then you would have proof that you didn't do those things like the whole situation could it take in 20 minutes

If he didn't do even one of the things he was accused of it would have taken less than the hour and a half he was given to screen share his screen with multiple Hermits and just start scrolling through Discord

Then he goes on to say that he wasn't given enough time etc... And that they'd rushed him.

There have been MULTIPLE sources stating they tried for MONTHS to get into contact with the Hermits.

But IT IS odd that when he was "notified" of his wrongdoings, he first went to the police and a lawyer, DESPITE a hermit telling you first. If everyone knows then it's not a matter of privacy anymore.

Like personally if that was me, I'd have jumped into Discord no questions asked, shown the proof THEN contacted a lawyer for defamation or other relating charges

It's very unusual for someone to go the legal route in the situation not because it's never been done before it's because it's a waste of money and time. They will not gaf. Most cases in the similar situations come out with inconclusive responses and the person does not come out with a response themselves as their is seemingly enough evidence to smear their name and they would not like to proceed if there's that much evidence.

And it's VERY clear he's going the "innocent till proven guilty" route. Which is fair enough.

But, and I cannot stress this enough, HE'S NOT BEING ACCUSED OF TEXTING MINORS

He's being accused of having inappropriate relationship with multiple members of his audience/community and moderators, and using his Discord server as the catalyst for it all.

Which is especially alarming as some have said he's a moderator for them, which IN SOME PLACES is illegal to have a boss/employee relationship.

But it genuinely sounds like he's missing the point, as a content creator you have to hold yourself to higher responsibilities, accountability and credibility then the rest of your community. And even if it's not illegal, it's EXTREMELY INAPPROPRIATE for a content creator to have any form of relations with a fan, WITHOUT it being for certain types of videos (like challenges or servers) or for commissions/work

So unless they were gaining genuine service or having particular videos, having that sort of PM relationships with your fans is inappropriate, especially if your working with them or not. It's not appropriate at all.

He then blames it on cancel culture. WHICH GIRL-

I've seen alot of things pumped out of Hermitcraft fans but "cancel culture" IS NOT ONE OF THEM

Blaming it on cancel culture is the biggest excuse, genuinely.

He acts like it was public execution, even through its been CONFIRMED from MULTIPLE SOURCE that people tried for months to get into contact with the Hermits, so the END OF THE INAPPROPRIATE RELATIONS WITH MEMBERS OF YOUR COMMUNITY SHOULD HAVE BEEN WARNING NUMBER 1-

Like imagine all the people you allegedly had relations with suddenly all wanted to cut contact, did you think they would just disappear?

Cancel Culture, is when you're cut from your career for doing something OBJECTIVELY stupid, as it becomes a growing trend. It's unserious and often a social media trend.

Iskall's situation was not apart of cancel culture because it's genuine. And he knows it's genuinely enough to take legal action, meaning that in some capacity he did do at least 20% of what he's been accused of, to have grounds for a cases

So he's done SOMETHING it's just not what he thinks it is/isn't like what's allegedly

Then he goes on to talk about a developer he defended after they scammed him and we're generally not nice.

I have yet to see this developer anywhere and to my knowledge they have not pushed any allegations onto him.

He instead brings up this developer, because he defended them when they did something that was seemingly objectively wrong and it's meant to be a display of his good character

Personally I would have not used that as an example. Using an example of you defending someone when you in the same breath claimed that they had wronged you is putting the notion in your fans and audiences heads that even "if I do something wrong you should defend me because it was only a silly little mistake and it's the right thing to do"

And it was unnecessary. Completely unnecessary. He wants to be a display of a good character yet also once privacy so that's why he shares a personal story of him defending someone who wronged him so show that he's a good person who gives second chances? But then implies in the video that he had to give that person more than one chance?

And I think Goodtimeswithscar said it better then me. GASLIGHTING he's hardcore gaslighting.

It is similar to what Mr Beast, did with his allegations. Actually it's almost a copy.

Instead of completely addressing it he only addresses what he wants to in the face of privacy. He then brings up all the good things he's done to make him seem more trustworthy and like a better person even. And then he pays someone to investigate himself to find himself not guilty.

Iskall it's literally doing the same thing. He only addresses what he wants to because of privacy even though he knew about the situation before he got a lawyer, he uses the worst example possible to show that he's a trustworthy person, and then he pays for a lawyer himself to prove that he is not guilty.

Having the police and lawyers is meant to make it seem more 'fair'. But as we all know the police will only do so much before a lawyer has to step in. And if you're paying for the lawyer yourself obviously the lawyer is going to have bias because they want to do a good job because you are paying them to do a good job.

It's the most hardcore gaslighting I've ever seen.

And worst of all he might actually get away with it, because like Mr Beast he has a younger audience who will not understand how much he's trying to Gaslight them.

So to conclude, he's doing a Dream / Mr Beast remix on a smaller scale because money. And he's getting lawyer involved and unless they're suing for defamation, then there's nothing to sue for because no one is accusing him of pedophilia they are accusing him of having inappropriate relationships with his audience which is a big no-no for content creators..

Now for Stressmonster

Girl dug herself either a hole or a grave and now has to lie in it.

They tried to protect her dignity and integrity by not stating the reason why she left but it's now clear to many why she also left.

And yet again I would like to make it very clear like no one is accusing him of actually committing a crime (UNLESS HE LIVES IN AN AREA THAT MAKES IT ILLEGAL FOR BOSS AND EMPLOYEES/COWORKERS TO HAVE A RELATIONSHIP) he's being accused of having inappropriate relationships with members of his community and moderators, which is not a very good thing if you're a content creator

Its not a jailable offence unless *see point above*, and to be like "I'm standing with you 100% of the way!", is more telling about your priorities than 'what is right'

They act as if hermitcraft is a cult, that kicks members out for not conforming.

But I am entirely on the side of HermitCraft in the fact that I would indeed, kick Iskall out/get him to resign, if he'd had inappropriate relations with mods and fans REGARDLESS OF IF THEY WERE ADULTS

Because the main audience for Hermitcraft ARE CHILDREN. KIDS. NON-ADULTS

AND HE'S ENDANGERING THEM AS WELL AS THERE COMMUNITY EVEN IF IT'S NOT MINORS HE'S MESSAGING

LIKE GROWING UP IN A COMMUNITY WHERE IF YOU EVENTUALLY REACH AN ACCEPTABLE AGE YOU GET TO HAVE A PRIVATE RELATIONSHIP WITH THE CONTENT CREATOR YOU'VE BEEN IDOLISING FOR YOUR CHILDHOOD ARE YOU INSANE?

Overall he's digging himself a grave and handing out shovel.

And also. To be sosososososo clear.

NEVER. SEND. DEATH. THREATS. TO. ANYONE.

[oh-no-its-bird]

Hear me out: warring states era Hatake who went on a mission somewhere in the land of waves and fell off the fucking map— where they then witnessed the Unspeakable Timeless Horrors Of The Sea And Spiral, then washed up on shore a solid years later, irreversible changed and tangibly Other.

Their wolf contract no longer works because there is something so deeply Wrong with them that animals (especially contract beats and spirits) can feel it. There is something tangibly, legitimately Other(tm) about them, and while they've been wholeheartedly accepted back into the clan, everyone knows this is not the same person who they lost a year ago

They gazed into the abyss and the abyss gazed back type shit fr

[biohazardousgeodez]

What Are The Savage Babies? The history and origin of the savage baby meme

[badninken]

Writing little Law engaging normally with his environment and then realizing that oh shit! he'd totally need a stepping stool or a little collapsible ladder to even use a kitchen sink. Rewriting the scene.

[yardsards]

i personally think marcille is bisexual but in the "i am attracted the Occasional anime twink and also every woman who has ever walked the earth" way. like a solid 5 on the kinsey scale, y'know?

[cryptidwithacopiccollection]

hi can i request a merstoph gavin if you haven't done one yet 💜

One Fishtoph Gavin for u

& a pissed-off fishtoph gavin too

Send me an ask and I'll draw a Mer-attorney!

[arkos404]

fanart for the personality swap au, the lawful joke au, by @chaosaliien

love makes you blind fr, prism bailed immediatedly afterwards, here some of the other fits he tried before tho (yes scrabby reacted the same way to all of them)

,,,,,also tagging @flaint and @rateater2000 bc they said they were looking forward to it 👉👈 sorry it took this long lol, some of the refs below

[nimudae]

Super late for White Day but oh well

After Luffy's gift, Law thinks the polite thing to do is to gift him back. Nothing big or personal, just some chocolates and Luffy's favorite flower. That's Casual and Not Serious enough, right?

(Luffy takes it as a human confession of course 💕)

[Ko-fi]

[symbologic]

Law thought he'd need to change the world to honor Cora's sacrifice

But he was already living Cora's legacy: Simply by being with the people he loves, the family he created for himself in the wake of Cora setting him free

You'd almost expect Law to wander alone for years after Cora's death. And in a different story? I think that's likely what would've happened so the MC could finally show him what love means

But Law met Bepo and the others within a few days of Cora's death

And so Law fulfilled Cora's dying wish — continued to fulfill that wish everyday after that, even — without ever realizing it. There is something so devastatingly beautiful about that

[aquilae-stims]

( ⚖ )