dudeofdata

[dudeofdata]

Training Proposal: PySpark for Data Processing

Training Proposal: PySpark for Data Processing Introduction:This proposal outlines a 3-day PySpark training program designed for 10 participants. The course aims to equip data professionals with the skills to leverage Apache Spark using the Python API (PySpark) for efficient large-scale data processing[5]. Participants will gain hands-on experience with PySpark, covering fundamental concepts to…

[dudeofdata]

10 things a dead man know what an alive man doesnt

Is there life after death or it it just a void The Alive people cannot perceive the dead. Can the dead people percieve the live. Why cannot alive and dead people communicate.  What about Ghosts and seances Is there a soul Is there a heaven. How is it for different religions Does God exist and does he punish you for bad things you did when alive Is there rebirth or reincarnation Does good…

[dudeofdata]

Movie Review 12 th Fail Hindi

After a long time I have felt like writing a movie review for the Hindi movie 12 th Fail It is an astounding take of a poor village boy who crosses all hurdles cleans toilets sweeps libraries and basically hangs in there to clear one of the most difficult exams in the world the UPSC Or Indian Civil Services. It is even more incredible because it is based on a true story. With great acting and…

[dudeofdata]

Movie Review - The Flash 2023

This is a cleverly written movie with suitable twists and the right amount of nostalgia too. Only problem is excess CGI especially when the Flash is flashing at light speed. The multiple Batmans make an interesting multiverse

[dudeofdata]

Generative AI Studio

Zero-shot prompting – This is a method where the LLM is given no additional data on the specific task that it is being asked to perform. Instead, it is only given a prompt that describes the task. For example, if you want the LLM to answer a question, you just prompt “what is prompt design?”. One-shot prompting – This is a method where the LLM is given a single example of the task that it is…

[dudeofdata]

Image Captioning

What is the name of the model that is used to generate text captions for images? Encoder-decoder model What is the purpose of the decoder in an encoder-decoder model? To generate output data from the information extracted by the encoder What is the purpose of the attention mechanism in an encoder-decoder model?To allow the decoder to focus on specific parts of the image when generating text…

[dudeofdata]

Transformer and BERT

What are the three different embeddings that are generated from an input sentence in a Transformer model? Token, segment, and position embeddings 2.What kind of transformer model is BERT? Encoder-only model 3.What is the name of the language modeling technique that is used in Bidirectional Encoder Representations from Transformers (BERT)? Transformer 4.What does fine-tuning a BERT model…

[dudeofdata]

Attention Mechanism

What is the name of the machine learning technique that allows a neural network to focus on specific parts of an input sequence?check Attention mechanism How does an attention model differ from a traditional model? Attention models pass a lot more information to the decoder. What is the name of the machine learning architecture that can be used to translate text from one language to…

[dudeofdata]

Encoder-Decoder Architecture

. What is the purpose of the decoder in an encoder-decoder architecture?  -To generate the output sequence from the vector representation  -To predict the next word in the output sequence What is the purpose of the encoder in an encoder-decoder architecture? -To convert the input sequence into a vector representation What are two ways to generate text from a trained encoder-decoder model at…

[dudeofdata]

Responsible AI

Which of the below is one of Google’s 7 AI principles? AI should uphold high standards of scientific excellence. Why is responsible AI practice important to an organization? Responsible AI practice can help build trust with customers and stakeholders. Organizations are developing their own AI principles that reflect their mission and values. What are the common themes among these…

[dudeofdata]

Generative AI and LLMs

What is Generative AI?: checkGenerative AI is a type of artificial intelligence (AI) that can create new content, such as text, images, audio, and video. It does this by learning from existing data and then using that knowledge to generate new and unique outputs. Hallucinations are words or phrases that are generated by the model that are often nonsensical or grammatically incorrect. What are…

[dudeofdata]

2023 Data Science Survey: Please Participate & Help spread the word

Rexer Analytics has been conducting the Data Science Survey since 2007. Each survey explores the analytic behaviors, views, and preferences of data scientists and analytic professionals. This year we are excited to work with Eric Siegel and his Machine Learning Week organization to design, promote, and analyze this Data Science Survey. Summary reports from previous surveys are available FREE to…

[dudeofdata]

The Batman is the worst Batman movie sans Ben Affleck

The Batman is the worst Batman movie sans Ben Affleck

We have seen Batman movies before. The Gold Standard of the Nolan Trilogy. The original series of Keaton-Kilmer-Clooney (Clooney was terrible too) Ben Affleck was a bad Batman , but better than Daredevil This one is an attempt to make Batman the Greatest Detective some angst and brooding. It fails All you have is a wasted effort and a long movie I could be a better Batman. Its like that

[dudeofdata]

Coconuts

[dudeofdata]

Movie Clip- NSA

[dudeofdata]

MLFlow on Azure Databricks

MLFlow on Azure Databricks

On Azure Databricks you can create experiments using MLFlow https://mlflow.org/ notebook_path = ‘/Users/Ajay/Folder’ notebook_path = notebook_pathmlflow.set_experiment(notebook_path + ‘_experiments’) with mlflow.start_run(run_name=”ExperimentRun”+curr_ts):mlflow.log_params({‘RSME’: RSME,‘AUC’:…

[dudeofdata]

Extract date from datetime in Pandas column

Extract date from datetime in Pandas column

use .dt.date df[‘column’] = pd.to_datetime(df[‘column’], format=’%Y-%m-%d’).dt.date Source- https://stackoverflow.com/questions/16176996/keep-only-date-part-when-using-pandas-to-datetime