Just out of curiosity. I have no moral stance on it, if a tool works for you I’m definitely not judging anyone for using it. Do whatever you can to get your work done!
High school history teacher here. It’s changed how I do assessments. I’ve used it to rewrite all of the multiple choice/short answer assessments that I do. Being able to quickly create different versions of an assessment has helped me limit instances of cheating, but also to quickly create modified versions for students who require that (due to IEPs or whatever).
The cool thing that I’ve been using it for is to create different types of assessments that I simply didn’t have the time or resources to create myself. For instance, I’ll have it generate a writing passage making a historical argument, but I’ll have AI make the argument inaccurate or incorrectly use evidence, etc. The students have to refute, support, or modify the passage.
Due to the risk of inaccuracies and hallucination I always 100% verify any AI generated piece that I use in class. But it’s been a game changer for me in education.
I should also add that I fully inform students and administrators that I’m using AI. Whenever I use an assessment that is created with AI I indicate with a little “Created with ChatGPT” tag. As a history teacher I’m a big believer in citing sources :)
How has this been received?
I imagine that pretty soon using ChatGPT is going to be looked down upon like using Wikipedia as a source
I would never accept a student’s use of Wikipedia as a source. However, it’s a great place to go initially to get to grips with a topic quickly. Then you can start to dig into different primary and secondary sources.
Chat GPT is the same. I would never use the content it makes without verifying that content first.
Is it not already? I’ve found it to be far less reliable than Wikipedia.
This is why I read through everything I use to make sure it’s accurate.
Well the people that use it know that, but for the average person, chatgpt still has a high reputation
Is it fair to give different students different wordings of the same questions? If one wording is more confusing than another could it impact their grade?
I had professors do different wordings for questions throughout college, I never encountered a professor or TA that wouldn’t clarify if asked, and, generally, the amount of confusing questions evened out across all of the versions, especially over a semester. They usually aren’t doing it to trick students, they just want to make it harder for one student to look at someone else’s test.
There is a risk of it negatively impacting students, but encouraging students to ask for clarification helps a ton.
My professors would randomize the order of the questions instead.
I have had professors that essentially create chiral A & B versions and also randomize the order. Never underestimate the amount of effort a lazy student will go through to cheat.
I use ChatGPT to create banks of questions that are aligned to the essential topics that I need students to learn. Then I randomly assign the same number of questions to each student from each essential topic. I give the students the list of topics to focus their studying on.
I also have other “categories” that form their final grade, things like participation and homework assignments. So any marginal unfairness that might result from randomized test questions is more that made up for over the course of everything I grade them on.
Sure it could but the same issue is present with one question. Some students will get the wording or find it easy others may not. Having a test in groups to limit cheating is very common and never led to any problems as far as my anecdotal evidence goes.
You’re increasingly the odds by changing the wording. I don’t see why it’s necessary. Just randomize the order of the questions would suffice.
I’m a special education teacher and today I was tasked with writing a baseline assessment for the use of an iPad. Was expecting it to take all day. I tried starting with ChatGPT and it spat out a pretty good one. I added to it and edited it to make it more appropriate for our students, and put it in our standard format, and now I’m done, about an hour after I started.
I did lose 10 minutes to walking round the deserted college (most teachers are gone for the holidays) trying to find someone to share my joy with.
I wish I had that much opportunity to write (or fabricate) my own teaching material. I’m in a standardized testing hellscape where almost every month there’s yet another standardized test or preparation for one.
It’s one of the fascinating paradoxes of education that the more you teach to standardized tests, the worse test results tend to be. Improved test scores are a byproduct of strong teaching - they shouldn’t be the only focus.
Teaching is every bit as much an art as it is a science and straight-jacketing teachers with canned curricula only results in worse test scores and a deteriorated school experience for students. I don’t understand how there are admins out there that still operate like this. The failures of No Child Left Behind mean we’ve known this for at least a decade.
Removed by mod
I don’t have any bosses, but as a consultant, I use it a lot. Still gotta charge for the years of experience it takes to understand the output and tweak things, not the hours it takes to do the work.
Basically this. Knowing the right questions and context to get an output and then translating that into actionable code in a production environment is what I’m being paid to do. Whether copilot or GPT helps reach a conclusion or not doesn’t matter. I’m paid for results.
A junior team member sent me an AI-generated sick note a few weeks ago. It was many, many neat and equally-sized paragraphs of badly written excuses. I would have accepted “I can’t come in to work today because I feel unwell” but now I can’t take this person quite so seriously any more.
Classic over explaining to cover up a lie.
I never send anything other than “I’ll be out of the office today” for every PTO notice.
Exactly and lets me honest you coworkers don’t want to heard about you explosive diarrhea problems or the weird mole on your butt.
Ask yourself why they felt the need to generate an AI sick note instead of being honest 👌
I dunno, I’d consider it a moral failing on the part of the person who couldn’t be honest and direct, even if there’s a cultural issue in the workplace.
Dunno, everyone else seems to be happy sending a one-liner 👌
Exactly, if they’re too lazy to write a fake sick note then they’re certainly too lazy to work, either send them in for remediation or terminate them, either way they shouldn’t be in the workplace
I had a coworker come to me with an “issue” he learned about. It was wrong and it wasn’t really an issue and the it came out that he got it from ChatGPT and didn’t really know what he was talking about, nor could he cite an actual source.
I’ve also played around with it and it’s given me straight up wrong answers. I don’t think it’s really worth it.
It’s just predictive text, it’s not really AI.
I concur. ChatGPT is, in fact, not an AI; rather, it operates as a predictive text tool. This is the reason behind the numerous errors it tends to generate and its lack of self-review prior to generating responses is clearest indication of it not being an AI. You can identify instances where CHATGPT provides incorrect information, you correct it, and within 5 seconds of asking again, it repeat the same inaccurate information in its response.
It’s definitely not artificial general intelligence, but it’s for sure AI.
None of the criteria you mentioned are needed for it be labeled as AI. Definition from Oxford Libraries:
the theory and development of computer systems able to perform tasks normally requiring human intelligence, such as visual perception, speech recognition, decision-making, and translation between languages.
It definitely fits in this category. It is being used in ways that previously, customer support or a domain expert was needed to talk to. Yes, it makes mistakes, but so do humans. And even if talking to a human would still be better, it’s still a useful AI tool, even if it’s not flawless yet.
It just seems to me that by this definition, the moment we figure out how to do something with a computer, it ceases to be AI because it no longer requires human intelligence to accomplish.
As Larry Tesler once said “AI is whatever hasn’t been done yet.”
i think learning where it can actually help is a bit of an art - it’s just predictive text, but it’s very good predictive text - if you know what you need and get good and giving it the right input it can save a huge about of time. you’re right though, it doesn’t offer much if you don’t already know what you need.
Can you hand me an example? I keep hearing this but every time somebody presents something, be it work related or not, it feels like at best it would serve as better lorem ipsum
I’ve had good success using it to write Python scripts for me. They’re simple enough I would be able to write them myself, but it would take a lot of time searching and reading StackOverflow/library docs/etc since I’m an amateur and not a pro. GPT lets me spend more time actually doing the things I need the scripts for.
A use it with web development by describing what I want something to look like and have it generate a React component based on my description.
Is what it gives me the final product? Sometimes, but it’s such a help to knock out a bunch of boilerplate and get me close to what I want.
Also generating documentation is nice. I wanted to fill out some internal wiki articles to help people new to the industry have something to reference. Spent maybe an hour having a conversation asking all of the questions I normally run into. Cleaned up the GPT text, checked for inaccuracies, and cranked out a ton of resources. That would have taken me days, if not weeks.
At the end of the day, GPT is better with words than I am, but it doesn’t have the years of experience I have.
More often than not you need to be very specific and have some knowledge on the stuff you ask it.
However, you can guide it to give you exactly what you want. I feel like knowing how to interact with GPT it’s becoming similar as being good at googling stuff.
Isn’t that what humans also do and it’s what makes us intelligent? We analyze patterns and predict what will come next.
I’ve played around with it for personal amusement, but the output is straight up garbage for my purposes. I’d never use it for work. Anyone entering proprietary company information into it should get a verbal shakedown by their company’s information security officer, because anything you input automatically joins their training database, and you’re exposing your company to liability when, not if, OpenAI suffers another data breach.
The very act of sharing company information with it can land you and the company in hot water in certain industries. Regardless if OpenAI is broken into.
Run llama locally: https://github.com/cocktailpeanut/dalai
I’ve been using it a little to automate really stupid simple programming tasks. I’ve found it’s really bad at producing feasible code for anything beyond the grasp of a first-year CS student, but there’s an awful lot of dumb code that needs to be written and it’s certainly easier than doing it by hand.
As long as you’re very precise about what you want, you don’t expect too much, and you check its work, it’s a pretty useful tool.
I’ve found it useful for basically finding the example code for a 3rd party library. Basically a version of Stack Exchange that can be better or worse.
I essentially use it as interactive docs. As long as what you’re learning existed before 2021 it’s great.
Yeah sadly the times I’ve gotten screwed is when a major version change occurred in 2022. Got burned once doing that and now I know to check to see if we have upgraded past the version the code works before spending too much time working on it.
I don’t know you, the language you use, nor the way you use chat gpt, but I’m a bit surprised at what you say. I’ve been using chatgpt on a nearly daily basis for months now and while it’s not perfect, if the task isn’t super complicated and if it’s described well, after a couple of back and forth I usually have what I need. It works, does what is expected, without being an horrendous way to code it.
And gpt4 is even better
My job involves a lot of shimming code in between systems that are archaic, in-house, or very specific to my industry (usually some combination of the three), so the problems I’m usually solving don’t have much representation in gpt’s training data. Sometimes I get to do more rapid prototyping/sandbox kind of work, and it’s definitely much more effective there where I’m (a) using technologies that might pop up on stack overflow and (b) don’t have a set of arcane constraints the length of my arm to contend with.
I’m absolutely certain that it’s going to be a core part of my workflow in the future, either when the tech improves or I switch jobs, but for right now the most value I get out of it is as effectively a SO search tool.
Got it. With context, it makes much more sense.
I myself use some of the most widely used programming language ( php and react mostly ) so yhea, there’s plenty to be found with those
I, like most peaple, find it easier to write code than to read it. That “check its work” step means more work actually, for me
not chatGPT - but I tried using copilot for a month or two to speed up my work (backend engineer). Wound up unsubscribing and removing the plugin after not too long, because I found it had the opposite effect.
Basically instead of speeding my coding up, it slowed it down, because instead of my thought process being
- Think about the requirements
- Work out how best to achieve those requirements within the code I’m working on
- Write the code
It would be
- Think about the requirements
- Work out how best to achieve those requirements within the code I’m working on
- Start writing the code and wait for the auto complete
- Read the auto complete and decide if it does exactly what I want
- Do one of the following depending on 4 5a. Use the autocomplete as-is 5b. Use the autocomplete then modify to fix a few issues or account for a requirement it missed 5c. Ignore the autocomplete and write the code yourself
idk about you, but the first set of steps just seems like a whole lot less hassle then the second set of steps, especially since for anything that involved any business logic or internal libraries, I found myself using 5c far more often than the other two. And as a bonus, I actually fully understand all the code committed under my username, on account of actually having wrote it.
I will say though in the interest of fairness, there were a few instances where I was blown away with copilot’s ability to figure out what I was trying to do and give a solution for it. Most of these times were when I was writing semi-complex DB queries (via Django’s ORM), so if you’re just writing a dead simple CRUD API without much complex business logic, you may find value in it, but for the most part, I found that it just increased cognitive overhead and time spent on my tickets
EDIT: I did use chatGPT for my peer reviews this year though and thought it worked really well for that sort of thing. I just put in what I liked about my coworkers and where I thought they could improve in simple english and it spat out very professional peer reviews in the format expected by the review form
Those different sets of steps basically boil down to a student finding all the ways they can to cheat and spending hours doing it, when they could have just used less time to study for the test.
Not saying that you’re cheating, just that it’s the same idea. Usually the quickest solution is to just tackle the thing head-on rather than find the lazy workaround.
What I think ChatGPT is great for in programming is ‘I know what I want to do but can’t quite remember the syntax for how to do it’. In those scenarios it’s so much faster than wading through the endless blogspam and SEO guff that search engines deal in now, and it’s got much less of a superiority complex than some of the denizens of SO too.
As a side note, whilst I don’t really use AI to help with coding, I was kinda expecting what you describe, more so for having stuff like ChatGPT doing whole modules.
You see, I’ve worked as a freelancer (contractor) most of my career now and in practice that does mostly mean coming in and fixing/upgrading somebody else’s codebase, though I’ve also done some so-called “greenfield projects” (entirelly new work) and in my experience the “understanding somebody else’s code” is a lot more cognitivelly heavy that “coming up with your own stuff” - in fact some of my projects would’ve probably gone faster if we just rewrote the whole thing (but that wasn’t my call to make and often the business side doesn’t want to risk it).
I’m curious if multiple different pieces of code done with AI actually have the same coding style (at multiple levels, so also software design approach) or not.
A lot of people are going to get fucked if they are…
It’s using the “startup method” where they gave away a good service for free, but they already cut back on resources when it got popular. So what you read about it being able to do six months ago, it can’t do today.
Eventually they’ll introduce a paid version that might be able to do what the free one did.
But if you’re just blindly trusting it, you might have months of low quality work and haven’t noticed.
Like the lawyers recently finding out it would just make up caselaw and reference cases. We’re going to see that happen more and more as resources are cut back.
Huh? They already introduced the paid version half a year ago, and that was the one being responsible for the buzz all along. The free version was mediocre to begin with and has not gotten better.
When people complain that ChatGPT doesn’t comply to their expectations it’s usually a confusion between these two.
Like the lawyers recently finding out it would just make up caselaw and reference cases. We’re going to see that happen more and more as resources are cut back.
It’s been notorious for doing that from the very beginning though
Anyone blindly trusting it is a grade A moron, and would’ve just found another way to fuck up whatever they were working on if ChatGPT didn’t exist.
ChatGPT is a tool, if someone doesn’t know what they’re doing with it then they are gonna break stuff, not ChatGPT.
This is exactly like people who defend Tesla by saying it’s your fault if you believed their claims about what a Tesla can do…
Which isn’t a surprise, there’s a huge overlap between being gullible to believe either companies claims, and some people will vend over backwards to defend thos companies because of sink cost fallacy
I don’t know what OpenAI even claims that ChatGPT can do, but if you trust marketing from any company then you’re gonna get burnt.
I’m not defending the company in any way, more just defending that in general LLMs can be useful tools, but people need to make educated decisions and take a bit of responsibility.
That may have been their plan, but Meta fucked them from behind and released LLama which now runs on local machines, up to 30B parameter size and by end of the year will run at better than GPt3.5 ability on an iphone.
Local llms, like airoboros, WizardLm, Stable Vicuña or Stable Coder are real alternatives in many domains.
Uh, Llama, at least the versions I can run (up to 64B on CPU if I’m into waiting an hour for the reply) is far behind gpt3.5, and that is without considering GPT4. Even GPT3.5 is a toy compared to 4.
Llama2 is supposedly better, but still not quite at 3.5 levels. Of course, that’s amazing considering the resource difference, but if all you care about is the endresult, then you still have to wait for some advancements.
Some of my co-workers use it, and it’s fairly obvious, usually because they are putting out even more inaccurate info than normal.
Not because their grammar and phrasing improved suddenly?
They mainly use it for code and scripts.
Urgh one of my coworkers (technically client, but work closely alongside) clearly uses it for every single email he sends, and it’s nauseating. He’s crass and very poorly spoken in person, yet overnight all his email correspondence is suddenly robotic and unnecessarily flowery. I use it regularly myself, for fast building of Excel formulas and so forth, but please, don’t dump every email into it.
Why should anyone care? I don’t go around telling people every time I use stack overflow. Gotta keep in mind gpt makes shit up half the time so I of course test and cross reference everything but it’s great for narrowing your search space.
I did some programming assignments in a group of two. Every time, my partner sent me his code without further explanation and let me check his solution.
The first time, his code was really good and better than I could have come up with, but there was a small obvious mistake in there. The second time his code to do the same thing was awful and wrong. I asked him whether he used ChatGPT and he admitted it. I did the rest of the assignments alone.
I think it is fine to use ChatGPT if you know what you are doing, but if you don’t know what you are doing and try to hide it with ChatGPT, then people will find out. In that case you should discuss with the people you are working with before you waste their time.
I’ve had partners like that in the past. If ChatGPT didn’t exist they would’ve found another way to cheat or avoid work.
The type of partner who takes the task you asked them to complete, posts the task description on an online forum and hope someone gives them the answer.
Yes but I think it is a bit different because it just lowers the bar for this a lot. You also really lose trust in everything once you realize that you have spent a lot of time interacting with and checking AI generated stuff without knowing.
I get that. Before ChatGPT if I had a bad partner it is very quickly obvious that their work is bad.
Now you might be tricked into thinking they’re competent, which I can imagine is more frustrating because it’s unpredictable.
I guess that right now people are overusing it as it’s so new, but in the end the people who want to graduate without trying to learn will always try to abuse whatever tools they have to cheat. Usually they face the consequences at some point in their lives.
To really be successful you need to be curious enough to want to understand things at a deep level. With LLMs people who don’t really care well learn even less than before.
This is the key with all the machine learning stuff going on right now. The robot will create something, but none of them have a firm understanding of right, wrong, truth, lies, reality, or fiction. You have to be able to evaluate its output because you have no idea if the robot’s telling the truth or not at that moment. Images are pretty immune to this because everyone can evaluate a picture for correctness or realism, and even if it’s a misleading photorealistic image, well, we’ve already had Photoshops for a long time. With text, you always have to keep in mind that the robot might be low quality or outright wrong, and if you aren’t equipped to evaluate its answers for that, you shouldn’t be using it.
Even with images, unless you’re looking for it most people will miss glaring problems. It’s like that basketball video psychology experiment.
The problem is definitely bigger with LLMs though since you need to be an expert to check the output for validity. I will say when it’s right it saves a ton of time, but when it’s wrong you need to know enough to tell.
Yes, LLMs are great as a research assistant if you know what to look for, but they’re a horrible learning tool. It’s even worse if you don’t know the correct way to search for an answer, it will set you down a completely wrong path. I don’t use any answer without cross referencing and testing it myself. I also rewrite most of the code it spits out too since a lot of it follows terrible programming patterns and outdated standards.
He should’ve at least looked at the code and tested it before sending it to you. Ugh. Hate doing assignments with people who do the bare minimum and just waste your time.
The problem with using it is that you might be sending company proprietary or sensitive information to a third party that’s going to mine that information and potentially expose that information, either directly or by being hacked. For example, this whole thing with Samsung data: https://techcrunch.com/2023/05/02/samsung-bans-use-of-generative-ai-tools-like-chatgpt-after-april-internal-data-leak/
We’ve been instructed to use ChatGPT generically. Meaning, you ask it generic questions that have generic usage, like setting up a route in Express. Even if there is something more specific to my company, it almost always can be transformed into something more generic, like “I have a SQL DB with users in it, some users may have the ‘age’ field, I want to find users that have their age above 30” where age is actually something completely different (but still a number).
Just need to work carefully on ChatGPT.
I’ve done so on rare occasion, but every time it made stuff up. Wanted terraform examples for specific things… and it completely invented resource types that don’t exist.
Based on the code I’ve seen from our devs, it must be getting worse. It’s never produced acceptable quality imo, but the examples I’ve seen lately are laughably bad.
It’s definitely gotten weirder lately, I think they keep training it on data and they’re not looking into that data enough. That’s the thing about AI though, it has to come up with an answer. You gave it a prompt. It will come up that answer even if it’s not a good one
It’s not a search engine or encyclopedia. If you want facts, you have to use the tools for facts.
Love your username!
Soul skaters 4 lyfe!
Not sure how it could help me solder or find faults on PCBs.
Make bing ai analyze the picture
Pretty sure I’ve RMA’d a few pieces of hardware where they did just that
I use it to write performance reviews because in reality HR has already decided the results before the evaluations.
I’m not wasting my valuable time writing text that is then ignored. If you want a promotion, get a new job.
To be clear: I don’t support this but it’s the reality I live in.
This is exactly what I use it for. I have to write a lot of justifications for stuff like taking training, buying equipment, going on business travel, etc. - text that will never be seriously read by anyone and is just a check-the-box exercise. The quality and content of the writing is unimportant as long as it contains a few buzz-phrases.
Just chiming in as another person who does this, it’s absolutely perfect. I just copy and paste the company bs competencies, add in a few bs thoughts of my own, and tell it to churn out a full review reinforcing how they comply with the listed competencies.
It’s perfect, just the kinda bs HR is looking for, I get compliments all the time for them rofl.
Work smarter, not harder, lol.
Can you please elaborate on your experience of HR people deciding the results before the evaluation? Just curious
Sure!
It happens behind closed doors and never in writing to keep up the farce, but usually I’m given a paltry number of slots of people I can label as high performers. This is really a damn shame because most of my team members are great employees. This is used as a carrot to show that we do give raises and promotions after all, but the proportion is so small it’s effectively zero. I’m very clear to my team that trying to becoming a top performer to get a promotion is a bad investment. I do my best to communicate the futility without actually saying it literally in such a way that it could get me into trouble.
Next, they use a spreadsheet to figure who they can probably underpay based on a heuristic likelihood that person would actually leave vs current market rates. These automatically become the low performers ahem satisfactory. You’re penalized for being here longer or specializing in something with a small market. Everyone else falls somewhere between satisfactory and above average which makes little difference.
The performance reviews are merely weak documentation to show that somehow HR was “justified” by selectively highlighting strengths or weaknesses depending on the a priori decision of what your performance level was to be.
It’s a huge tautology with only one meaningful conclusion: you will be underpaid, and it gets worse over time.
Thanks. This is great insight and tracks with some personal experience or experience of friends.
You could make a whole post about this topic, but I was curious what’s your advice to an employee that wants to do good work, but who doesn’t want to be taken advantage of?
The truth is you have to do good work for yourself because you care about the quality of your work. You work for you.
You separate the factors. You do good work for you because you care because a life doing things you don’t care about is less meaningful.
Separately you look at pay. You leave when it’s no longer worth staying, which for most people is about every two to three years at least for your early career.
deleted by creator
Only used it a couple of times for work when researching some broad topics like data governance concepts.
It’s a good tool for learning because you can ask it about a subject and then ask it to explain the subject “as a metaphor to improve comprehension” and it does a pretty good job. Just make sure you use some outside resources to ensure you’e not being hallucinated all over.
My bosses use it to write their emails (ESL).
ESL is actually a great use, although there’s a risk someone might not catch a hallucination/weird tone issue. Still it would be really helpful there.
Best used in tandem with something like languagetool.org for the final revision.
yeah my biggest use case it quick summaries of things. it’s great getting a few bullet points, and i miss details a lot less.
Removed by mod
When I’m pissed off I use it to make my emails sound friendly.
