#deployments

[foundations-cowboy]

Remind me ta smack Dresden upside the noggin' next time we're in a meetin'...

[portlandnet]

2025.01.22 BES Green Streets Stewards program

Sign up to become a Green Street Steward

Complete information about the program

Weed identification guide

Log time as a Green Street Steward as a NET in MIP under Deployments

[dgruploads]

AWS EKS | Episode 10 | ReplicaSets, Deployments and Services in Kubernetes | Lets discuss.

[govindhtech]

Filestore Powers Massive JupyterHub At UC Berkeley

Filestore powers one of the biggest JupyterHub deployments in US higher education at UC Berkeley.

What is JupyterHub?

JupyterHub, which makes Jupyter Notebooks more accessible to larger user groups, has emerged as a crucial platform for collaborative data science, enabling researchers, students, and developers to work together on challenging projects. The manner that data science education is delivered at scale has been completely transformed by its capacity to oversee numerous user contexts and grant access to shared resources.

However, these advantages are not without difficulties, as anyone who has worked on a large-scale JupyterHub implementation will attest. Managing file storage for a variety of users and computationally demanding operations soon becomes a major challenge as deployments scale. To guarantee seamless operations and effective workflows, storage solutions must be dependable, scalable, and performant.

UC Berkeley uses JupyterHub as a collaborative data science environment for students, teachers, faculty, staff, and researchers possibly the largest such deployment in American higher education. They employ Datahub, a highly customised Zero to JupyterHub implementation, which consists of more than 15 hubs serving 15,000 users across more than 35 departments and more than 100 courses. Naturally, punctuality and accessibility are critical as assignments and projects have due dates, and academic calendars control quizzes and examinations.

When UC Berkeley and Google initially began corresponding, UC Berkeley was very forthright about the difficulties of maintaining such a sizable and engaged user base, particularly given its limited resources. They experienced financial difficulties, similar to many other colleges, which made it challenging to staff a sizable IT team. Actually, a small team consisting of just two full-time employees was overseeing this enormous JupyterHub deployment, with the help of devoted volunteers and part-time workers.

It was soon evident that their current setup, which depended on user home directories that were self-managed and mounted on a self-managed NFS service that was hosted on Google Compute Engine, was not keeping up with the demands of the growing organisation. Their expanding user base required a more dependable and integrated experience, so they had to find a way to handle demand growth without sacrificing usability or speed.

Being a preeminent research university, they also had to strike a compromise between the demands of their constrained IT funds and the objectives of cross-departmental training. This is where the managed NFS storage solution Filestore from Google Cloud comes into play. Google hope that by revealing UC Berkeley’s path to Filestore, Google will be able to offer insightful analysis and useful advice to anyone facing comparable obstacles in their own pursuits.

What makes Filestore special?

The squad was operating in almost continual crisis mode when Shane joined it in October 2022. A surge of new Datahub customers in the middle of the semester taxed the capacity of the GKE architecture. Worse, the self-managed NFS service would frequently crash from overload.

By re-architecting the configuration to segregate particular course hubs and JupyterHub support infrastructure into their own node pools, the team was able to fix the GKE performance issues. For such users, this improved performance, but the underlying storage problems remained. One key point of failure had emerged: the self-managed NFS service. The team had installed a systemd timer that automatically restarted the NFS service every 15 minutes as a band-aid solution to keep things operating.

Although total disruptions were avoided, the self-managed infrastructure was still having difficulty keeping up. The user base continued to increase quickly, workloads were getting heavier, and the budget was just not able to keep up with the ongoing demand for additional servers and storage. They required a more economical and successful solution. At that point, they got in touch with the Filestore team and Google Cloud. The UC Berkeley team was persuaded that Filestore was the best option in less than an hour. Because the Filestore Basic HDD tier allowed them to customise instance size and was reasonably priced, they were especially intrigued in it.

It’s important to note that there are three Filestore tiers: Basic, Zonal, and Regional, and selecting between them isn’t always an easy choice before delving into UC Berkeley’s move. Although basic instances have limitations on capacity control (you cannot reduce capacity), they offer good performance. For workloads involving data science education that must be completed with minimal delay, zonal instances offer lightning-fast performance.

However, they are restricted to a particular zone within an area, as the name implies. In the event of an outage in that zone, the workloads may be affected. In contrast, Filestore Regional synchronously replicates data among three zones in a region to safeguard it in the event of a failure in one of the zones. The three of them trading places? Cost, flexibility in storage management, performance, and storage SLA. Selecting one of the three requires balancing performance with your level of patience for downtime. Budgetary constraints and capacity limitations will undoubtedly also be important factors in the choice.

Making the switch from Filestore to DIY NFS

Shane and his group were excited to test Filestore as soon as they had a firm grasp of it. They launched a demonstration deployment, establishing a connection between a Filestore instance and a smaller JupyterHub environment. Being the hands-on Technical Lead that he is, Shane jumped right in, pushing the system even further by running some bonnie++ benchmarks from within a single user server notebook pod.

Handling Filestore

Shane and his team at UC Berkeley have experienced a level of performance and stability they never would have imagined possible after switching to Filestore. They claim that Filestore is now a “deploy-and-forget” solution. Their users, those thousands of students who rely on Datahub, haven’t reported any performance concerns, and they haven’t had a single minute of outage.

Their management overhead has also been significantly decreased. They have a few basic Google Cloud alerts configured to interact with their current PagerDuty system and notify them in the event that any Filestore instance fills up to 90% of its capacity. These warnings are uncommon, though, and increasing storage when necessary is simple.

They have put into practice a straightforward yet efficient plan to further optimise their consumption and keep costs under control. They right-size their Filestore instances depending on usage trends after archiving user data to Cloud Storage at the conclusion of each semester. To make sure they are only paying for the storage they require, they either build smaller instances or combine hubs onto shared instances. For data migration between instances, Rsync continues to be their go-to partner. Although it takes time, this operation has become a standard component of their workflow.

In conclusion

The experience of UC Berkeley emphasises an important lesson for anyone implementing large-scale educational platforms as force multipliers for teaching: the complexity and volume of JupyterHub installations increase, and with them, so do the demands on the supporting infrastructure. Finding solutions that are both financially viable and technically sound is essential to success. Filestore proved to be that solution for Datahub, offering a potent combination of performance, reliability, and operational efficiencies and empowering the upcoming generation of data scientists, statisticians, computational biologists, astronomers, and innovators, despite the presence of some missing automation tools, a minor learning curve with Filestore Basic, and a higher price tag.

Read more on govindhtech.com

[bopbop171]

AU where Dane just comes home and joins the OIAR simply because he's just too fucking stupid.

[abbotjack]

SHAWN HATOSY as ELVIS SCHMIDT Alpha Dog (2006)

[rambunctioustoons]

creature loose in the facilities again !!!

[foundations-cowboy]

Man if ya'll think I'M an ass, wait till you meet Calvin. That guy got a stick so far up his arse you'd think he'd vommit apples.

[scuderiatomcat]

inspired by this headcanon from @anittmyer

after settling in miramar as instructors, when they both started melting to each other, ice decided to invite mav for chill night. while preparing drinks he left mav stumbling around house. everything is fine, until ice hears loud call to come over.

he founds mav staring at his wall with pictures. particularly one, where little tommy is sitting on his father’s shoulders near man, who also holding little brown haired boy.

“is that you and your dad? do you know who’s that?” “well, no. i don’t know who’s that. dad was stationed at manila and we went there with him, i think…”

and that’s how tom kazansky found himself being dragged to nextdoor home’s bedroom, looking at the same picture at mav’s wall.

turns out they both were at the same time, at the same place almost 20 years ago and after confirming with parents, they discovered that little tommy and pete were inseparable during 3 month period

almost whole life later, after hearing this story, daggers would call them true soulmates and they would laugh, reminiscing about good old times

[republicansaredomesticterrorists]

Scholars fear this could be a pretext for Trump to take over Blue cities and even entire Blue states.

[dgruploads]

AWS EKS | Episode 9 | Control Plane and Namespaces in Kuberenetes

[mikibwrites]

The Price is Right

inspired by @theweewooshow 's post about a kissing booth :) Happy Valentines Day everyone!

bucktommy | 1.4k | G | ao3

This is ridiculous. He’s officially lost his marbles. 

Tommy’s been in this line for at least fifteen minutes, and every third minute of that has been spent telling himself he should leave. The other 2 minutes of each spiraling cycle have been spent eavesdropping his fellow hopefuls in line, listening to their tittering about how hot the firefighter working this shift of the booth is, surreptitiously cataloguing every person that he can see in front of and behind him and evaluating them on what–little, sadly–he knows about Evan’s preferences and whether or not their dreams of bagging a date with him will come true. Which then, in turn, sends him back into spiraling and berating himself for being among them, given his history with said firefighter. 

He needs to leave. 

There are roughly ten people in front of him, and Evan definitely hasn’t spotted him yet. He could totally duck out and no one would be the wiser. He contemplates pulling his phone out of his pocket with an air of importance, putting the completely silent device to his ear and pretending something dire has just happened that requires his immediate attention. No one would question him for getting out of line, no one would suspect that he’d lost his nerve. They’d think, wow, he must be important to be needed somewhere so urgently. 

Tommy’s definitely, officially for real this time, lost his marbles. 

Also, there are now only seven people left in front of him. 

As he watches each person get their sweet little peck on the cheek, he tries to tell himself this is for a good cause. The money goes to charity. There’s nothing weird about giving to charity. Nothing at all. There’s also nothing stopping him from just dropping the money in the basket on a table near the door that’s designated for just plain donations. He doesn’t need to get anything out of it if that’s all he’s hoping to do. 

He’s definitely hoping to get something out of it. He can at least admit that to himself, if nothing else. 

Five people left. 

“Oh my god, he’s so hot,” Tommy hears from behind him. “Look at those arms. Hold me down, daddy.” He almost chokes, the girl’s voice clearly pitched for just her friend next to her to hear, but he’s apparently blessed with supersonic hearing. The friend chimes in as well. “I wonder if he’s actually a good kisser or if he’s one of those dudes who relies on his rizz alone and then can’t deliver when it counts.”

Tommy has no idea what ‘rizz’ is, but he has to physically stop himself from turning around and describing for this girl in detail just how good of a kisser Evan is, how well he can deliver. He’s sure that wouldn’t go over well. 

Two people left. Evan is being so gracious and attentive to each of his patrons that he still hasn’t noticed Tommy. He could still make a run for it. 

He’s not going to. 

There’s roughly enough time for one more cycle of spiraling before he makes it in front of Evan, but Tommy chooses to spend it going over what the hell he’s going to say. Surely, Evan may protest giving his ex a kiss, even if it’s for charity, given the way they ended. It’d be well within his right to do so. So Tommy needs to have some justifications ready just in case Evan gets the wrong idea here. 

And what is the idea? Tommy failed to decide before he attempted this ridiculous stunt. Honestly, he’s been so, so god damned touch starved since he walked out Evan’s door that he thinks he’d do anything for just a brush of fingertips from Evan at this point. And that’s it, really…he only wants it from Evan. His coworkers have told him multiple times that he needs to just go out and get his ex out of his system–Donato offered to wingperson for him, even–but the very idea turns his stomach. 

But did he actually think that throwing some money at charity at a kissing booth of all things was going to get them anywhere near a reconciliation? Jesus, he should have just texted. Not that he hasn’t tried that, many many many times, and all of them ended up deleted because regardless of what he likes to tell himself he does not have the courage to put himself out there without the reassurance–or despair–of seeing Evan’s actual expression when he says what he wants to say. 

Which is…what? Exactly? He still hasn’t deci–

“Tommy?”

Shit. He’s missed the last person in front of him getting their dutiful peck on the cheek, and now he’s run out of time. 

Evan’s voice as he says his name is full of awe, trepidation, and…dare he say it…hope? His expression is even more devastating: like he’s seeing the sunrise just beginning after a century spent underground. His narrowed eyes are earnest and a little guarded, but they are trained wholly on Tommy.

Shit….what was he going to say?

“Uh, yeah. Hi. I, um…well I. Uh.” Tommy runs his fingers over his hair roughly, feeling unbearably stupid and exposed. He should have run when he had the chance. “Look, Evan, I–”

Evan’s breath hitches audibly at the sound of his name. They’re staring at each other. 

“Shit or get off the pot, dude, we’re all paying customers!” Some guy further back in line is shouting. 

“Um. Did you want a kiss?” Evan says, his face turning pinker by the second. And this. This Tommy can definitely answer.

“Yes,” he says, with maybe a little too much conviction behind the word for their current circumstances. Evan seems to clock it immediately, his eyes flicking down to Tommy’s mouth before coming back up to his eyes, his expression morphing to hopeful disbelief. “But, I mean, you don’t have to, here, I know you probably weren’t expecting–”

Tommy’s words are cut off by Evan’s mouth sealing onto his. 

God, god, he’s missed these lips. Each slide is like a revelation, and the thought is not lost on him that they’re in the middle of what is essentially a work function, they are both in uniform for christ's sake, having a whole existential crisis shared along with their breath and space and saliva. Because yes, Evan has now bullied his insanely talented tongue right behind Tommy’s teeth and is exploring like he’s going to be asked to draw a map later. 

Evan kisses him long, hard, and thorough, endless seconds ticking by and Tommy definitely doesn’t listen to any of the complaining going on in the line behind him. Evan does, though, and he very reluctantly pulls his lips away from Tommy’s and blinks in the most adorably flustered way and Tommy’s so, so gone on this man. How did he ever walk away from this?

“Can we talk?” Evan asks breathlessly.

“Please. But maybe later. Your adoring public awaits,” he adds, gesturing with his thumb to the line behind him, still nearly thirty people strong. He can’t blame them, but he’s also feeling a tad possessive so he leans in one more time to press his lips to the apple of Evan’s cheek, causing the blush to intensify when he pulls away. 

Tommy begins to turn to walk away, his smile already making his cheeks sore when Evan clears his throat. He raises an eyebrow. “You didn’t pay, you know.” He’s smirking, the little shit. 

Before Tommy can make a move, someone in line shouts, “Damn! How much does it cost to get that?”

“That is not for sale,” Evan states with finality, but he’s still looking at Tommy, lips pursing, trying to hold back a full blown grin. There are a few groans from the line. 

Tommy reaches into his wallet, pulls out a $100, and slaps it on the table in front of Evan. “What time does your shift end?”

“In thirty minutes.”

“Meet me at the cafe two blocks down. Bring those lips. We’ll talk.” Tommy congratulates himself on being smooth as he smirks right back at the look on Evan’s face. 

“Mmm, okay. I’ll bring these lips. But I hope you remember they’re good for more than just talking,” Evan adds as Tommy turns to walk away. 

He retracts his self-congratulations as he trips over his own feet. 

[temeyes]

he is legally blind, your honor

[justablognothingweirdhere]

I just know that Robby absolutely adores Abbot’s natural hair color.

[chickensauras]

Drew guys from @mayakoroz new toxic old man yaoi fic: Advent

(Made a text and the subtext version) :Þ

Obv check the tags, but i really fuck with the characterization, all the internalized bullshit, askeladd fallin on his ass like an idiot ❤️ . Also the fumbling lol