#robot.txt
Explore tagged Tumblr posts
Text
Can I rest my head on someone's chest as they run their fingers through my hair.
I think that'd be really helpful rn.
910 notes
·
View notes
Text
Everybody look at how cute the nostalgia trams are.




They're so tiny, I want to give them a little kiss.
56 notes
·
View notes
Text
just got an email saying the spare unicycle cranks and non-slip pedals are out of stock
#the second i get back on my unicycle the pedal comes clean off and now the parts are out of stock#like how many customers do you guys have??#i wouldn't be so fustrated if this didn't happen as soon as i get back into the hobby#i was so excited....................#robot.txt
2 notes
·
View notes
Text
sometimes i think about how Jason Might not be that soft with me when I make self indulgent stuff .then I remember Everything
#guy stopped fighting his brother after getting hugged. cried while arguing with his dad but still said he forgave him --#etc etc.#🦇jt.files#robot.txt
1 note
·
View note
Note
Hi this was me, I finally made a sideblog! I'm very new to the community. ^^
(Questioning) objectum culture is being very into the idea of cities that are sentient and love you or hate you.
Also machines. Wires and buttons and cogs. I have said enough.
.
33 notes
·
View notes
Text
random shit but like,,, i got a message like,,, an hour ago and i was so excited because ive had zero idea what to coin
cue me realizing it was a bot

0 notes
Text
Does anybody know how to poison original writing against ai-scrapers? I tried to look it up, but all I found were people talking about how to pass the ai-detection tests or which writing software to use before publishing.
I want something I can do to my writing (in the same way I overlay textures on my art) that's going to poison ai-scrapers so I can feel comfortable posting my writing online.
I thought about posting my writing in a photo, but then that comes with the issue of being inaccessible, and adding alt-text would defeat the purpose of the photo. I don't want to throw in random gibberish either because that would ruin the story for readers.
I probably won't post any writing until after I've created a website for my works, but even then a lot of ai-scapers (esp chatgpt) have a tendency to completely ignore robot.txt files.
#writing#writer#writers#writeblr#author#creative writing#writers on tumblr#anti ai#anti generative ai#ai scraping#ai scapers
37 notes
·
View notes
Note
I don’t know if i already sent this to you because my internet is being shitty but anyways, I hate that I can’t save any fanfiction.net fics to the WayBack Machine because the website’s robot.txt blocks ia_archiver.
don't worry, anon! it sent!
135 notes
·
View notes
Text
GenAI is stealing from itself.
Fine, it's Dall-E... the twist is this... One of the influencing images seems to be this one which has a lot of matching features. AI stealing, fine.:
It's likely this one. (I found this via reverse image search) But something doesn't feel right about this one. So I looked it up...
It's Midjourney. lol
So AI is stealing from AI.
The thing is as people wise up and start adding these lines to robot.txt
GenAi has no choice but to steal from GenAI, which, Oh, poor developers are crying big tears is making GenAI worse. Oh poor developers crying that they no longer can steal images because of nightshade:
https://nightshade.cs.uchicago.edu/whatis.html and glaze:
To which I say, let AI steal from AI so it gets shittier.
Remember to spot gen AI, most of the devil is in the details of the lazy-ass creators.
This video goes over some of the ways to spot it (not mine). https://www.youtube.com/watch?v=NsM7nqvDNJI
So join us in poisoning the well and making sure the only thing Gen AI can steal is from itself.
Apparently stealing with one person with a name is not fine and is evil. But stealing from 2+ people is less evil as long as you don't know their names, or you do, because you went explicitly after people who hate AI like the Ghibli studio and you don't want to stare into Miyazaki's face.
Because consent isn't in your vocabulary? This is the justification that genAI bros give, including things like drawing is sooooo impossible to learn.
And if you don't understand consent, then !@#$ I don't think anyone wants to date you either. But I digress. The point is that we should push AI to learn from AI so that Gen AI becomes sooo crappy the tech bros need to fold and actually do what they originally planned with AI, which is basically teach it like it was a human child. And maybe do useful things like, Iunno, free more time for creativity, rather than doing creativity.
#fuck ai everything#ai is evil#fight ai#anti genai#fuck genai#fuck generative ai#ai is stealing from itself#anti-ai tools
3 notes
·
View notes
Text
It's a great day to be a fag
687 notes
·
View notes
Text
I'm so nervous, do you think she likes me?

Close up

#robot.txt#objectum#os/or#osor#computer#i felt so bad there was art on the wall but i kept staring at her
10 notes
·
View notes
Text
#seo expert#seo services#seo#technical seo#online marketing#digital marketing#seo marketing#search engine optimization
4 notes
·
View notes
Text
Search Engine Optmization
Search Engine Optimization (SEO)
HOW SEARCH ENGINE WORKS?
CRAWLING- Crawler/Bots/Spider search the data and scan the data from the server / Internet / web.
INDEXING- Indexing is to store data in search engine data base centre.
RANKING- Ranking is to show the result and give them ranking.
Techniques of SEO
White Hat SEO- It refers to any practice that improve your search ranking without breaking search engine guidelines.
Black Hat SEO- It refers to increase a site ranking by breaking search engine terms and services.
Black Hat SEO Types
Cloaking- It is the method of presenting users content that is different from search engine crawlers.
Content Hiding- This is done by same text colour as the background to improve ranking.
Sneaky URL Redirection- Door way pages are proper site that redirect to different page without their knowledge.
Keyword Stuffing- Practice of filling content with repetitive keyword in an attempt to rank on search engine.
Duplicate Content- It means to copy content from other website.
WHAT IS WEBSITE?
Domain- Domain is a simply name of the company.
Hosting- Hosting is a space or storage on server where we can store website.
Dealers of Domain and Hosting
GoDaddy
Hosting Raja
Hostinger
Blue Host
Name Cheap
WHAT IS SSL?
SSL Stands for Secure Socket Layer It is a technology for keeping an internet connection secure and sensitive data that is being sent between two system preventing criminals from reading and modifying any information transferred including personal details.
WHAT IS URL AND SUB DOMAIN?
URL- Uniform Resource Locater
Sub Domain- www,web,apps,m
KEYWORDS- Any query search in search box is known as keyword.
TYPES OF KEYWORD
Generic Keyword- It is used for brand name or general keyword it helps to balance your generic keywords to capture wide range of customer. Only one word is used.
Short Tail Keyword- These keywords are phase of two or three words.
Long Tail Keyword- Specific Keyword phase consisting more than three words.
Seasonal Keyword- These Keyword generate most of their search traffic during a specific time of the year.
GOOGLE SANDBOX EFFECT
It is a observation period done by the google to check whether your site is having any technical issues, fraud, scam and user interaction towards website.
SERP
Search Engine Result Page appears after some search something in the search box.
HTML
Hyper Text Markup Language
META TAG OPTIMIZATION
Title Tag- Digital Marketing
Meta tag- content=………….150 to 170 characters
FTP TOOLS
Core FTP
Filezilla
INDEXING AND CRAWLING STATUS
Indexing Status- Status which shows exactly when the site is stored in data base centre.
Crawling Status- Status which gives information about recent crawling of our website. eg. site:abc.com.
KEYWORD PROXMITY
It refers to distance between keywords.
Keyword Mapping
It is the process of assigning or mapping keywords to a specific pages of a website based on keyword.
IMAGE OPTIMIZATION
ALT Tag- It is used for naming images also known as alt attribute
<img src=”digital.png”alt=”name/keyword>
Image compressing-The process of reducing image size to lower the load time.
Eg. Pingdom- To check load time.
Optimzilla- To compress image.
Robot.txt
It is a file in which instructions are given to the crawler how to crawl or index the web page it is mainly used for pages like privacy policy and terms and conditions.
Robots meta Tag
They are piece of core that provide crawlers instruction for how to crawl or index the content. We put this tag in head section of each page it is also called as no index tag.
<meta name=”robots”content=”nofollow,noindex……………../>
SITE MAPS
It is list of pages of website accessible to crawler or a user.
XML site map- Extensible Markup Language is specially written for search engine bots.
HTML site map- It delivers to user to find a page on your website.
XML sitemap generator
CONTENT OPTIMIZATION
Content should be quality content (grammarly)
Content should be 100% unique (plagiarism checker)
Content should be atleast 600-700 words in web page.
Include all important keyword.
BOLD AND ITALIC
<b>Digital Marketing</b> <strong>……………</strong>
<i>Digital Marketing</i> <em>………………</em>
HEAD TAGGING
<h1>………..</h1> <h5>…………</h5>
<h2>………..</h2> <h6>………..</h6>
<h3>…………</h3>
<h4>…………</h4>
DOMAIN AUTHORITY(DA)
It is a search engine ranking score developed by moz that predict how website rank on SERP.
PAGE AUTHORITY(PA)
It is a score developed by moz that predict how well page will rank om SERP.
TOOL- PADA checker
ERROR 404
Page not found
URL is missing
URL is corrupt
URL wrong (miss spilt)
ERROR 301 AND 302
301 is for permanent redirection
302 is for temporary redirection
CANONICAL LINKS
Canonical Links are the links with same domain but different URL it is a html element that helps web master to prevent duplicate issues in seo by specifying canonical version of web page.
<link ref=”canonical”href=https://abc.com/>
URL STRUCTURE AND RENAMING
No capital letters 5. Use important keyword
Don’t use space 6. Use small letters
No special character
Don’t include numbers
ANCHOR TEXT
It is a click able text in the hyperlink it is exact match if include keyword that is being linked to the text.
<a href=”https://abc.com”>Digital Marketing</a>
PRE AND POST WEBSITE ANALYSIS
PRE- Domain suggestions and call to action button
POST- To check if everything is working properly
SOME SEO TOOLS
SEO AUDIT AND WEBSITE ANALYSIS
SEOptimer
SEO site checkup
Woorank
COMPITITOR ANALYSIS AND WEBSITE ANALYSIS
K-meta
Spyfu
Semrush
CHECK BACKLINKS
Backlinks watch
Majestic Tool
Backlinks checkup
CHECK WEBSITE LOAD TIME
GT-Matrix
Google page insights
Pingdom
PLUGIN OR EXTENSION
SEO quacke- site audit and web audit
SERP Trends- To check ranking on SERP
SOME GOOGLE TOOLS
Google search console
Google Analytics
Google keyword Planner
2 notes
·
View notes
Text
Nothing dirty about it. The standard on literally every webpage is to allow crawlers because that's how anything on the web is found. If your webpage isn't crawled, it won't appear on any search engine or (in case of other sites linking to yours) it's gonna appear without a description. Bad SEO = bad traffic = bad for getting out there.
They're actually doing you a favour by giving you a toggleable option in the first place so you don't have to go look up the syntax so you can do it yourself, though I don't really see how that would help anything because crawlers can just ignore it if they want. (the Google crawler respects the robot.txt but that's not the case for every crawler, and anyone can just write a malicious crawler if they wanted to and know how to program one).
If you truly want to actually block crawlers and not just put a sign there saying "pls don't crawl here" that they can ignore, you'll have to use different methods.
Huge thank you to Squarespace for fucking automatically opting peoples' websites in to let AI train on our site's data without letting us know. Real cool.
ARTISTS WHO USE SQUARESPACE, HERE'S HOW TO DISABLE AI CRAWLERS ON YOUR SITE!!
25K notes
·
View notes
Text
Fix crawled - currently not indexed | SeoBix
Struggling with crawl errors or pages not indexing on Google? Our expert SEO services are designed to identify and fix crawl errors and indexation issues, and ensure your website is fully optimized for search engines. From sitemap corrections to robot.txt fixes and technical audits, we help improve your site's visibility, performance, and rankings.
For More Information Visit Our Website - https://seobix.com
1 note
·
View note