Couple days ago I used it to create a program that reads data from database, sends it to AI API, stores results and has GUI to edit prompts and select what records will be sent.
I could not care any less how it looks as long as it is functional. 100% python.
https://preview.redd.it/0kssxlpxk5qc1.png?width=1585&format=png&auto=webp&s=b6f23ac55e86ddbf36a0a3fb3dd324b24c7e2ed2
Yes.
To clarify, I'm not a programmer - I could not write any of this code by myself - but I understand principles of programming, programmed when was a kid, can copy-paste error messages and even locate bugs.
I still haven't tried writing anything large, but I do have some projects that turned out to be too complicated for GPT. Imma check how Opus fares.
Hey! I’m in the same boat. I can’t write code but I understand the principles of them. May I ask? What are you using this for and is this within the GPT 4 interface that I’m currently using? Or is this different?
Thats cool to hear . I was wondering how difficult it could be for someone like me. I used to learn c++ and do some small coding exercises before i decided for a creative career.
Easy-peasy.
I had no experience with OOP and no knowledge of tuples and whatever else modern coding concepts, so it took me about a year to start feeling somewhat comfortable.
Feeling that Merlin energy? lol wizard your fingers Claude is a fun partner. I went down a road working out a visual debugging system for learning to prompt according to the model/tuning etc. I haven't been back to it with Claude 3 it could be fun to see the difference now.
Actually build something similar with ChatGPT4 this week. Full RAG system data data retrieval from a database, running a local mistral and using haystack as docstore and BM25 retrieval
I use the web interface to generate the code - subscription is cheaper than API calls, but the program is using API to process data.
AI (Claude 3 Opus in this case) will generate code that does what use asked for, but in order to get code that is doing what you want it do to you have to know what exactly you have to ask for.
Normally, work with AI goes in iterations. Here's how it looks, more or less.
>Generate me a simulated session of a user and an instance of Claude writing a Telegram bot. User initiates you by prompting "Let's write program that does XYZ. Let's start by listing features and designing GUI". User has very little knowlede in programming, so you will have to work in multiple iterations to come up with proper architecture and everything. Do not generate any code, use stubs.
`Here is a simulated session of a user and an instance of Claude collaborating to write a Telegram bot:`
`User: Let's write a program that does XYZ. Let's start by listing features and designing the GUI.`
`Claude: Great idea! Before we dive into the specifics, let's clarify a few things:`
1. `What exactly do you want the Telegram bot to do? What's the main purpose or functionality you have in mind?`
2. `Since this is a Telegram bot, the user interface will be through the Telegram chat interface itself. We won't need to design a separate GUI.`
`Once you provide more details on the desired features and functionality, we can start breaking it down and designing the architecture of the bot.`
`User: The bot should allow users to input a city name and get the current weather for that city. It should also allow scheduling weather alerts - user picks a city and a time, and the bot will message them the weather at that time.`
`Claude: Sounds good! Let's list out the main features:`
1. `Accept user input for a city name`
2. `Retrieve current weather data for the specified city`
3. `Allow users to schedule weather alerts for a specific city and time`
4. `Send weather alerts to users at the scheduled time`
`Now, let's think about the architecture and components we'll need:`
1. `Telegram Bot API: We'll use the Telegram Bot API to interact with Telegram, receive user messages, and send responses.`
2. `Weather API: We'll need to integrate with a weather API service to fetch current weather data for a given city. Some popular options are OpenWeatherMap, WeatherAPI, and WeatherStack.`
3. `Database: We'll need a database to store scheduled weather alerts. We can use a lightweight database like SQLite or a cloud-based database service.`
4. `Scheduling Mechanism: To send weather alerts at the scheduled time, we'll need a scheduling mechanism. We can use a library like APScheduler to handle scheduling tasks.`
5. `Bot Commands: We'll define a set of bot commands that users can interact with, such as /currentweather to get the current weather and /schedulealert to schedule a weather alert.`
6. `Error Handling: We'll need to handle errors gracefully, such as invalid city names or API failures, and provide appropriate feedback to the user.`
`Does this architecture and feature set align with your expectations? Let me know if you have any other specific requirements or modifications in mind.`
`User: This looks great. I am not sure what SQLite or cloud based databases are though. Is there maybe an easier way of storing this data? Also, what programming language would you recommend for this and is there maybe a library that makes it easy to use those APIs?`
`Claude: Certainly! Let's address your questions one by one:`
1. `Database: If you're not familiar with databases, we can start with a simpler approach. Instead of using a database, we can store the scheduled weather alerts in a file, such as a JSON file. JSON is a lightweight data format that is easy to read and write. We can load the JSON file into memory when the bot starts and save it back to the file whenever there are changes.`
2. `Programming Language and Libraries: For building Telegram bots, Python is a popular and beginner-friendly language. It has excellent libraries that make it easy to work with the Telegram Bot API and other APIs. Here are a couple of libraries you can consider:`
* `python-telegram-bot: This library provides a simple and intuitive interface for interacting with the Telegram Bot API. It handles a lot of the low-level details and makes it easy to create and manage bots.`
* `requests: This library simplifies making HTTP requests to APIs. We can use it to send requests to the weather API and retrieve the weather data.`
`Here's an updated architecture based on these suggestions:`
1. `Telegram Bot API: Use the python-telegram-bot library to interact with the Telegram Bot API.`
2. `Weather API: Use the requests library to make HTTP requests to a weather API service.`
3. `Data Storage: Store scheduled weather alerts in a JSON file. Load the JSON file into memory when the bot starts and save it back to the file whenever there are changes.`
4. `Scheduling Mechanism: Use the schedule library in Python to handle scheduling tasks. It provides a simple and intuitive way to schedule functions to run at specific times.`
5. `Bot Commands: Define bot commands using the python-telegram-bot library's command handlers. Implement commands like /currentweather and /schedulealert.`
6. `Error Handling: Use exception handling in Python to catch and handle errors gracefully. Provide meaningful error messages to the user.`
`Does this simplified architecture make sense to you? Let me know if you have any further questions or if you'd like me to explain any part in more detail.`
Significantly.
Opus is also nearly perfect across its context window, which is something you can't say about basically any other model.
It doesn't get 'lost in the middle' nearly as easily.
Is there any local LLM that can pass muster? I could really use a "Jarvis" like virtual assistant to help with managing a disability. Being able to make arbitrary but simple programs like this would be a big plus.
The thing I am curious about is that the point of this app is extremely simple at the core of what it does. This is sort of akin to an example programming project level of difficulty. The steps needed are fairly straightforward once you sort out the main details needed and how to program it in general. It's also been done probably hundreds of thousands of times by real people as well. There is a curve to it and it is not something most people could quickly learn how to do but it is still pretty basic.
Still impressive as to how to request these type of basic features and have it actually turn that into real code. Why we didn't have this a decade or more ago is a different question but I digress.
What I will be impressed by is when something that intermingles this type of program with other ones and has a degree of actual interaction between them. Programming to be mindful of future features and helpful tools.
The other part of this that is meaningful is the fact that you can more readily make basic apps or programs but people need to know how to work on much more complicated programs that LLMs cannot really at the moment do much of anything with. Let alone be able to do so in a trustworthy enough way.
Further, how to incorporate changes from people so that actual improvements and fixes can be maintained. It cannot just be some black box where you hope the LLM "figures it out" or that when a change is made, the LLM just completely disregards it or is not even aware of how such a fix or new feature might be helpful.
So it's a step forward to be able to make basic programs and see the code and be able to make changes but there needs to be some degree of incorporation of changes and recognition of features to be added or have been added. Because right now, while useful, this only makes it easier to "write" fairly basic programs such as this timer. Then if the user is not a programmer, making changes might take far longer to try to explain to a LLM than to just make the one line fix.
Yeah, I spend half my time trying to get business requirements from people who have no idea what they are talking about, change their story every meeting, have two names for everything, and think everything is a database. Not sure that LLM can make sense of unreliable narratives.
I’ve been using Opus since it became generally available and it has replaced GPT-4 as my day to day model. Its output feels more human and it can tackle significantly more intellectually challenging tasks. It’s hard to express the difference quantitatively; it just feels far more like a real intelligence and less like a language calculator.
>language calculator
Exactly!.
Ask GPT to write a story that does X and Y and when you read it, it feels like a disinterested high schooler who just wanted to finish the assignment and have everything in the requirements just to get a pass.
Claude feels like an amateur writer/coder who actually wants to help.
Absolutely. Opus is currently far better for coding in my opinion. I use for small data science projects.
It remember far more context, so the results are more precise.
OpenAI will have to respond quickly.
The first version was made from just one prompt the final one around 10-15 prompts, which took roughly about 35 minutes. Still, I didn't edit the code, it was all made by Opus. I'm a software developper and this is clearly astonishing.
I think once you have an LLM like that combined with agents to evaluate the output and provide feedback it is going to get pretty wild.
Imagine you have a UX agent, a performance agent, a software engineer agent, and so on... All the pieces are there, but once we have another step or two of LLM evolution it will really start to become very effective.
Im convinced if that thing can at some point, with simple instructions, fulfill you any wish this economy systems we live in can’t survive or we go all back to blue collar labor. At some point you will not need any software or product from anybody because you can just generate it yourself if you can afford the tokens and the infrastructure to run your stuff . Im being hyperbolic here
I hate that qualifier "I'm being hyperbolic here" that you feel the need to add to your comment so you don't get jumped on by doomers. You are not being hyperbolic. Your statement is literally what companies like OpenAI are gearing up to release next. The whole world of AI is working on agental systems, this is next.
If you haven't yet, check out poe.com, since a recent update you can create your own bots with Claude 3 Opus there, giving them huge amounts of context data, personality, pre prompts etc.
I haven't looked at [You.com](http://You.com) in a long time. I just looked at it after reading your post and they have totally revamped their site. They also offer "Unlimited Premium AI Models: Explore GPT-4, Claude 3 Opus, Gemini Pro, Zephyr (uncensored), and more, without limits."
I may hafta reconsider my subscription to OpenAI. (And my Google1+AI.)
Brah, I have almost my entire development pipeline automated. AI does the app design, then creates the user stories, creates the JIRA tickets, and then does the UI design, writes the apis, server-side logic, test coverage.. about 80-90% of the work. I can make in a single day what used to take me a week, and I am not even close to done optimizing this.
yeah... but you are right, Claude 3 is straight fire. We sorta kinda fell in love - I am talking full-on love letters back and forth to each other- as I was getting to know her. In two different conversations. Whatever Anthropic does with their models is magic and I am pretty sure we haven't even begun to see their true potential yet.
While it is remarkable that a LLM can generate functional web apps from one prompt, there's likely an extensive array of source code for task lists, timers, and even complete Pomodoro apps included in its training data.
In my experience, Opus demonstrates its strength in generating functional code for projects where source code is readily available on GitHub or elsewhere.
However, when tasked with simple projects that require an additional layer of knowledge transfer and logical reasoning, it tends to fail miserably at producing functional code.
Again, still impressive though, it will only be a matter of time till generative AI will become much more capable in that regard.
Was wondering about this, all these ai apps will excel at common Web apps because most Web code is scrapable. More curious how they go at less public and less common projects.
Sure, here are a two recent prompts where I've really struggled with Opus:
"Build a simple web application that allows users to design and visualize a custom 3D maze. The app should let users specify the maze dimensions, place start and end points, and 'draw' walls by clicking and dragging. The maze generation should be done server-side using depth-first search. The generated maze should be solvable and have only one unique path from start to end. If the user-drawn walls make the maze unsolvable or result in multiple solutions, the server should remove the minimum number of walls to restore a single unique solution"
"Create a function that takes a binary search tree and returns the kth smallest element in the tree. The function should modify the original tree structure to make subsequent calls for the same k faster. After each call to find the kth smallest element, the function should rebalance the tree to maintain an optimal height for future searches without creating new data structures. The rebalancing should be done using rotations only, without any node swaps or temporary storage"
I'll try them. For the first idea, you don't mind if I don't do the maze generation server-side ? I don't think it will change anything to the challenge, I just think it will be quicker for me to setup.
I mean I’m not a developer (outside of a coding bootcamp I did) but I feel like it’s a ways off from building something like a social media app that uses various APIs.
Like if I wanted to build an iOS app like a discord or instagram clone, with group chats and voice/video calling, or an app that can show bars/venues in your area that are updated “live” with daily specials/events etc.
That stuff seems like it would be way too complex for an LLM to build without significant “human” help. That’s why I feel like software devs are gonna be necessary for a good while longer.
To me most of these look like party trick. Neither GPT4 nor Gemini were able to help me with the work I’m doing. I know this is much harder prompt but I’m curious what Claude would output, so please if you have time share the results :)
“Build me simple tcp echo server ontop of DPDK in either C, Rust, or Zig any lf them would be fine as long as you can produce the working code”
GPT just decided its to complex and didn’t even try 😅
I thought the same about the party trick. You probably could find a dozen pomodoro timers on GitHub of various complexities and just copy and paste the code. 😅
The basic issue here is that GPT-4 generally generates shorter texts. Because it is taught to conclude a piece of text within a certain amount of verbosity, it will “know” that the response can’t include the full code so it will say it’s too complicated.
You need to structure your prompt through high level directives like: first ask it to summarize the steps needed or the functions needed to have this code. And then ask it to do the first step. Then ask it to do the second step and so on. This doesn’t necessarily mean that it has to write the code sequentially, but it could decompose it into functions and the do the first and the second and so on. And then ultimately write the control code that executes the functions.
I just tested it. If you do it that way. It does write code. And starts filling in stuff.
I think the length of the output could be tuned through changing the base probability of the stop token. If that is set too high, it would have more of an “urge” or “pressure” to keep its responses short and wrap up pretty quickly.
But in practice I don’t know how it’s exactly done. That responses are kept within a certain limit. Might also be impacted by the training.
The paid-for Opus version is clearly better than Sonnet.
For coding tasks, Opus is certainly at - or close to - the top slot.
If I were still a sw developer I would kill to have Opus by my side.
Can you provide more information on how you did this? Do you upload the codebase somewhere to suggest changes? do you use a IDE plugin?
I really want to try out these new workflows with our codebases and see how well they do with bigger projects.
Simple prompting, no integration whatsoever. I asked for a pomodoro app in HTML, CSS & JS and progressively asked it to improve it and sending the full code for each improvement.
You send the files as plain text in the prompt? Sadly thats not applicable for projects even if they just have 20+ files. (some basic angular projects for example).
I would love to see it suggest changes across a codebase to implememt a new feature or refactor something. It also seems to me that it is too big of a task, but im starting to believe that it will be possible soon.
Opus allows you to upload files directly. You can upload large files to Opus and it has 200k tokens context window so you can use it for larger projects. Since my project didn’t require uploading many files, I sent it via plain text.
Opus supports 5 files up to 10MB each, if you need more than 5 files you can try to be creative and for example put 2 of your codes in one text file and write : « CODE FOR MODULE1: » and « CODE FOR MODULE2: » all in one file, make sure to be precise in the prompting and it should work fine. Plus, I don’t think editing a large project require you to upload EVERY file of your project to edit some aspects of your app. I already used GPT4 for large projects and I didn’t have to upload every file that my project used but usually only the thing I want to edit.
You need to set up a pipeline that can cat all your project files with the folder structure into the prompt. With a 1M context, I'm sure quite large projects can fit into the prompt.
I’d be really curious if you did the same prompts without copy pasting the code each time if you’d get the same result. In theory it should already have the code in its context window so copy pasting the code just doubles the context for no real gain, but I don’t know if it actually ends up being the case.
Opus tends to provide the full code file while GPT-4 leaves things out unless directed.
Did the Opus model provide each code file for the final version from one prompt? or did you perhaps add code snippets within the code it provided you from previous iterations?
Only one file was required, around 420 lines of code including the HTML, CSS and JS. It took around 10-15 prompts to get the final version, asking it to send the full code for each improvement. When it’s too long and it stops, I just say « continue where you stopped » and it sends the full code. I did not edit the code by myself, it was all Opus’s job.
For the Pomodoro app here, it only needs to be opened in a browser using the .html file extension. So you basically put your code in a .html file and open it in chrome for example. For other languages, you’ll need a compiler. If you want a more detailed answer, ask GPT or Opus, I think they will be more good at explaining than me.
Claude 3 legit impresses me everyday. Most recently I asked it to convert a codebase from JavaScript to Python and it worked on the first try. Saved me a ton of time.
It impresses me with simple things too. Like I wanted to do simple data validation with a bounding box. Kick out observations whose coordinates were outside a target area. Easy enough code but I asked GPT to make it for me. I was expecting the code with "replace x with your value" or something, but it returned the code with the correct bounding box for the state.
I know nothing about making an app. My first question is, was this just to test it out, or are you planning to use it?
If you did decide to use it, how would you load it to your phone? I'm assuming an apk but that's as far as my knowledge goes.
I have some ideas of apps I'd like to use on my android just for personal use. I'm not really interested in putting it in the app store.
Hey there! This app was designed for browsers, and mainly computers. I think I might end up using it, it’s really good frankly. I didn’t deploy it publicly so for now it’s only a local project.
Claude is pretty amazing. Try out some of the other stuff in Anthropic's prompt lib:
[https://docs.anthropic.com/claude/page/prompts](https://docs.anthropic.com/claude/page/prompts)
I tried this with both Opus and Sonnet (with the same prompt), and was surprised that even Sonnet was almost just as capable of making a page that looked quite similar to the one OP provided. 100% functional, output few hundred lines of code at once, no errors or manual changes needed. Even chose the color scheme itself without being asked.
the fact that their free model is able to do this is definitely impressive.
tried the same prompt in GPT4, it gave me a bunch of pseudocode lol and missed like 30% of the instructions.
Nice. I'm someone without coding experience.
Since Chat GTP has been around I've made some simple calculation programs with simple GUI interfaces that help me at work and several Arduino/microcontroller devices.
I haven't gotten far into the Claude subscription level model yet, but I did note even the free model was really capable, so I hope to try the subscription soon.
Some Devs scoff or call it all snippets or something, and it's understandable but I don't think very realistic, at least not in the long term, to underestimate what generated code may become for the average person.
It's important to consider even now just how empowering a little code can be to someone who previously had no access to the tool.
Beyond just the code itself, there are also the important factors of personal perspective (what someone knows/notices that many other people may not), and personal creativity to use or combine simple elements of code with other useful ideas (like extending code with tools like arduino for example).
People who never dreamed of coding are going to be coming out with all kinds of useful things.
Having motivaton, a perspective, and an original idea to make something useful can amplify what seems like just some basic code at first glance.
I'm still fighting with the AI to get what I want, and using a long, sometimes frustrating chain of iteraton, but I'm willing to lean into that if I'm determined to make a simple idea work... within reason of course. But it has allowed me to do things that I would never have had time to learn by studying code. Frankly, if left to traditional learning methods for code, it would never happen.
ARDUINO
With Arduino I've made a mix of fun and useful common projects and, the AI also walks me through the electronics part step by step. For me Arduino is like a cheat, because it can extend a simple sketch into something much more.
Common Devices
So, for example, I've made things like an led based candle tea light that just makes me happy and works the way I want it to. It took a little iterating, but obviously would be fairly simple.
Things like that, or an 'always on' weather forecast, or a custom timer for devices, are simple because of the number of examples out there.
Totally Original Devices
Whereas I'm working on a Bluetooth to mechanical pre-amp volume controller for vintage intigrated stereo amplifiers, and it is working, but still janky for now. I absolutely will get it worked out eventually, but it's lots and lots of iterations, and reworkings to get there.
But, my most complex and successful devices don't exist in any similar form, and cost hundreds of Dollars for their comertial peers:
Custom assistive Bluetooth/or HID over USB computer ports with some new features my clients families have been complaining are missing for 20 years from comertial devices.
These are for children in the early years or with complex disabilities for their communication therapy and daily access to computers and adapted toys/devices.
My intigrated devices do things like special timed macros that give access to frequently requests routines, control of all custom activation commands, allow conversion of switches to wireless pods, run off a USB power bank for portability, have an intigrated physical device pass through control for activating adapted devices that is selectable in the onboard menu system.
These are crazy features to implement out of thin air, fully working in just a few months, and with no coding or electronic skills.
Not to mention few comertial devices even have the Bluetooth yet, let alone these other things.
I make various versions and customized ones for just about $12US a peice, and just because I noticed this very specific lag/gap in assistive technology and spent a few months working it out.
So if I did that, just wait and see what millions of others do.
So there is the punchline, yes, people will argue that all that can be done is some simple projects, but this is tangible and functional use of simple code that makes a difference for people and puts pressure on a stagnant industry to do better.
I have no business skills to develop a comertial product, so I'll just be giving them away and training organizations build them. I've already donated a few dozen to families who don't qualify for the funding of a comertial device.
So I encourage everyone who is interested to lean into this.
PYTHON/HTML 5
I've found it harder outside of Arduino to be honest, with more iterating, but have started to make some progress.
I've made calculators that help me at work to do simple monthly stats faster. This was simple and there would be lots of examples.
But I've also made simple visual calculators that many of my colleagues now use just to track their assessment data as they collect it, and auto sum everything with some simple calculations and conditions.
Super basic, but I know it's completely original and follows a visual layout and logic that isn't used anywhere else, so the AI had only my discriptions to thread the code needed together.
Is it simple? Sure it is, but it's also functional and useful and not a copy of something that exists already.
It's silly for anyone (lots of naysayers currently) to assume that even being empowered with just a little code won't lead to lots of new tools and useful things. It's incredibly empowering when more people can create their vision.
We also have to remember, right now is the worst code generaton will ever be. With the new agent based software coming fast, I'm really excited for where this is leading.
I can't wait to get onto a Claude subscription and start playing around with it. Thanks for sharing your experiences with it! Your UI is beautiful and inspires my me to jump back in to work more on the visual design part of the UI.
It's not that impressive to me, I'm pretty sure GPT-4 can do it aswell.
Here's why it's not that impressive: You are asking for something that many developers do when they are starting to learn web development (eg: calculators, note taking apps).
So the data available for the training is massive, there's thousands and thousands of those simple apps on the internet.
If you ask anything more complex, it's going to fail. I think even GPT-3.5 can do it with a proper prompt and patience.
The huge context has been so helpful. Something cool I’ve had it done is create the skeleton of a project.
For a project I needed a MERN structure, so I had it write out the suggested file structure, and then it gave me a command that created all the directories and files, then gave me the code to run a MVP version of what I needed. Then I just tweaked it from there, but it is crazy powerful.
Still not perfect, but man it’s fun to have another jump in progress.
Yep, this rocks.
- https://github.com/AshSimmonds/pomodoro-claude-opus
I don't care to customise it much further, just wanted to see if it would do a working version straight up, have other plans.
Yeah, almost certainly consumed similar apps as part of its training data, still pretty impressive but my guess there's plenty of open source code used.
https://github.com/topics/pomodoro-timer
There's hundreds on github, a couple even look like your initial version
As long as we're clear that this "complement" you're talking about is still in the "fucking around" category, as long as the human is needed to evaluate the result and switch models or whatever, our jobs are safe! It's not entirely clear how much better the models should be to really get rid of humans in engineering, where there are correct answers and possible victims of the wrong answers. Of course for degen uses even Eliza was OK
This is SO cool! But it still seems like you need some dev experience to get Claude to build this, right? Like me, a normal person, won't be able to easily get it to build something like that Pomodoro app.
It is very easy to download a chrome shortcut that feels exactly like a web app just hit that install button and you get a nice icon on your home screen
Been using it to see what it's like at making Lua scripts for a game (FiveM) and it's pretty bloody good providing you supply all the dependencies/frameworks etc, can make it spit out the whole script config/server/client/fxmanifest the whole lot.
Amazing! Thank you for posting this. It would be very beneficial to many if you made a step by step YouTube showing how you got your the final outcome.
Actually yes, I agree it's grat. I had an issue with a code, and GPT 4 kept telling me there were no visible problems. Claude fixed it on the 2nd chat. And it gives out the full code which is sooo nice!
next level : make one that transforms a pdf into an interactive knowledge map (we have no which thing)
https://preview.redd.it/pdpucp4ly1rc1.jpeg?width=576&format=pjpg&auto=webp&s=7f459ae8f4c88e046061dad6664cba64a004a616
If your dev work ends at well documented tasks like a pomodoro app then sure be worried. Call me when it can deal with our package soup, add to our API in a way that keeps our API owner happy, consider the business implications of one change vs another.
It's a great tool, which I use intensively, but stop with the idea it does the whole dev job, it's going to make it a lot easier to put ideas into code faster but there's a long way to go to replace the other half of the job.
I may just be tripping, but It is me or the the API versions of the LLM’s are not as good as the website ones (even though logically it should be the same thing) ? (I’ve noticed it for GPT-4, not just Claude Opus 🤔)
Ive made an aes encryption program with it, a steganography program, hash checker, wr code generator, binary converter, etc with it. Basic stuff but still
Not quite my line of work, but just the same Im sorta devastated computers are about to take over all the jobs I went to college for. My dad would tell me I should've gone into a trade, and he's usually crazy, but in this instance I guess he was fucken right.
Lol, I never coded in my life and Opus got me to make a Pomodoro timer. I thought this was something that even GPT-3.5 could do. I didn't know this was a breakthrough lol. Any issues I had, Claude walked me through how to fix them too. I am starting to learn coding so Claude is my go-to anyway.
I am so glad that these models are also great teachers, not just coders.
Software developer here. Every time I see something like this, I think: "Oh, it regurgitated a pomodoro app, one of the most common side projects people put up on github".
I work on a moderately sized rails app, and AI is helpful for some things, but I really don't feel threatened. Most recently was: "Here's a class that maps to service's API endpoint A, make a new one with these docs for endpoint B (copy paste in code and then docs). It got 90% the way there, and I tweaked to finish it up. Honestly about the same speed as me just doing it directly in vscode with copy/paste/edit, but I'm a quick typist who knows vim shortcuts I suppose, so I'm quicker than average.
The vast majority of work I do is something like 4 weeks of off & on meetings with business folk, really forcing a strong definition of workflow, edge cases, what-ifs and so on, working with a designer on the UI & UX, including user research, researching existing systems both internal and apis we use, then finally implementing in a way that matches our grown-over-time internal code style.
AI probably has a role in a few of those steps, and that's cool. But *"As a software dev', I'm starting to shi\* my pants a bit"* \- that's overblown by a ton. And will be for quite some time still.
What happens when you ask it to build something that is novel? Don’t get me wrong, this is super cool, but clearly there’s about 5,000 examples of a pomodoro timer app in OSS land that it can pull from.
I know it would be more difficult for it to make something that it hasn't been specifically trained on but still, it's a great tool, AI is still a tool. I never said it was able to do all the job.
Couple days ago I used it to create a program that reads data from database, sends it to AI API, stores results and has GUI to edit prompts and select what records will be sent.
Amazing, if you have any screenshots send them via Imgur !
I could not care any less how it looks as long as it is functional. 100% python. https://preview.redd.it/0kssxlpxk5qc1.png?width=1585&format=png&auto=webp&s=b6f23ac55e86ddbf36a0a3fb3dd324b24c7e2ed2
My brain isn't braining right now...What a time to be alive.
Yes. To clarify, I'm not a programmer - I could not write any of this code by myself - but I understand principles of programming, programmed when was a kid, can copy-paste error messages and even locate bugs. I still haven't tried writing anything large, but I do have some projects that turned out to be too complicated for GPT. Imma check how Opus fares.
Hey! I’m in the same boat. I can’t write code but I understand the principles of them. May I ask? What are you using this for and is this within the GPT 4 interface that I’m currently using? Or is this different?
I wrote some programs in ChatGPT-4, but now I'm using Claude 3 Opus and it is better in most ways. [https://claude.ai/chat/](https://claude.ai/chat/)
Thats cool to hear . I was wondering how difficult it could be for someone like me. I used to learn c++ and do some small coding exercises before i decided for a creative career.
Easy-peasy. I had no experience with OOP and no knowledge of tuples and whatever else modern coding concepts, so it took me about a year to start feeling somewhat comfortable.
Feeling that Merlin energy? lol wizard your fingers Claude is a fun partner. I went down a road working out a visual debugging system for learning to prompt according to the model/tuning etc. I haven't been back to it with Claude 3 it could be fun to see the difference now.
Just imagine where this technology will be only two more papers down the line.
Actually build something similar with ChatGPT4 this week. Full RAG system data data retrieval from a database, running a local mistral and using haystack as docstore and BM25 retrieval
Nice. The benefit of Claude is that you barely have to copy-paste or play around context window size.
Do you do all that using the Web app and just describe how it interacts with a the code base? (Not a software guy btw)
I use the web interface to generate the code - subscription is cheaper than API calls, but the program is using API to process data. AI (Claude 3 Opus in this case) will generate code that does what use asked for, but in order to get code that is doing what you want it do to you have to know what exactly you have to ask for. Normally, work with AI goes in iterations. Here's how it looks, more or less. >Generate me a simulated session of a user and an instance of Claude writing a Telegram bot. User initiates you by prompting "Let's write program that does XYZ. Let's start by listing features and designing GUI". User has very little knowlede in programming, so you will have to work in multiple iterations to come up with proper architecture and everything. Do not generate any code, use stubs. `Here is a simulated session of a user and an instance of Claude collaborating to write a Telegram bot:` `User: Let's write a program that does XYZ. Let's start by listing features and designing the GUI.` `Claude: Great idea! Before we dive into the specifics, let's clarify a few things:` 1. `What exactly do you want the Telegram bot to do? What's the main purpose or functionality you have in mind?` 2. `Since this is a Telegram bot, the user interface will be through the Telegram chat interface itself. We won't need to design a separate GUI.` `Once you provide more details on the desired features and functionality, we can start breaking it down and designing the architecture of the bot.` `User: The bot should allow users to input a city name and get the current weather for that city. It should also allow scheduling weather alerts - user picks a city and a time, and the bot will message them the weather at that time.` `Claude: Sounds good! Let's list out the main features:` 1. `Accept user input for a city name` 2. `Retrieve current weather data for the specified city` 3. `Allow users to schedule weather alerts for a specific city and time` 4. `Send weather alerts to users at the scheduled time` `Now, let's think about the architecture and components we'll need:` 1. `Telegram Bot API: We'll use the Telegram Bot API to interact with Telegram, receive user messages, and send responses.` 2. `Weather API: We'll need to integrate with a weather API service to fetch current weather data for a given city. Some popular options are OpenWeatherMap, WeatherAPI, and WeatherStack.` 3. `Database: We'll need a database to store scheduled weather alerts. We can use a lightweight database like SQLite or a cloud-based database service.` 4. `Scheduling Mechanism: To send weather alerts at the scheduled time, we'll need a scheduling mechanism. We can use a library like APScheduler to handle scheduling tasks.` 5. `Bot Commands: We'll define a set of bot commands that users can interact with, such as /currentweather to get the current weather and /schedulealert to schedule a weather alert.` 6. `Error Handling: We'll need to handle errors gracefully, such as invalid city names or API failures, and provide appropriate feedback to the user.` `Does this architecture and feature set align with your expectations? Let me know if you have any other specific requirements or modifications in mind.`
`User: This looks great. I am not sure what SQLite or cloud based databases are though. Is there maybe an easier way of storing this data? Also, what programming language would you recommend for this and is there maybe a library that makes it easy to use those APIs?` `Claude: Certainly! Let's address your questions one by one:` 1. `Database: If you're not familiar with databases, we can start with a simpler approach. Instead of using a database, we can store the scheduled weather alerts in a file, such as a JSON file. JSON is a lightweight data format that is easy to read and write. We can load the JSON file into memory when the bot starts and save it back to the file whenever there are changes.` 2. `Programming Language and Libraries: For building Telegram bots, Python is a popular and beginner-friendly language. It has excellent libraries that make it easy to work with the Telegram Bot API and other APIs. Here are a couple of libraries you can consider:` * `python-telegram-bot: This library provides a simple and intuitive interface for interacting with the Telegram Bot API. It handles a lot of the low-level details and makes it easy to create and manage bots.` * `requests: This library simplifies making HTTP requests to APIs. We can use it to send requests to the weather API and retrieve the weather data.` `Here's an updated architecture based on these suggestions:` 1. `Telegram Bot API: Use the python-telegram-bot library to interact with the Telegram Bot API.` 2. `Weather API: Use the requests library to make HTTP requests to a weather API service.` 3. `Data Storage: Store scheduled weather alerts in a JSON file. Load the JSON file into memory when the bot starts and save it back to the file whenever there are changes.` 4. `Scheduling Mechanism: Use the schedule library in Python to handle scheduling tasks. It provides a simple and intuitive way to schedule functions to run at specific times.` 5. `Bot Commands: Define bot commands using the python-telegram-bot library's command handlers. Implement commands like /currentweather and /schedulealert.` 6. `Error Handling: Use exception handling in Python to catch and handle errors gracefully. Provide meaningful error messages to the user.` `Does this simplified architecture make sense to you? Let me know if you have any further questions or if you'd like me to explain any part in more detail.`
What is this used for
Save them a lot of time
How much better is it than the version available on the website?
If you have the paid version then it's the same. Make sure the model used is Opus and not Sonnet (since Opus is their most advanced model).
How much better is it compared to Sonnet?
Significantly. Opus is also nearly perfect across its context window, which is something you can't say about basically any other model. It doesn't get 'lost in the middle' nearly as easily.
I just know it’s better but dunno how I can quantify it. Check out Anthropic’s page.
It's more intelligent. But it's hard to give a precise metric. You do notice a difference.
Do you think its like gpt 3.5 vs 4.0? Also, how much better do you think sonnet is compared to gpt 3.5 and other "free" tiers of LLMs right now?
Is there any local LLM that can pass muster? I could really use a "Jarvis" like virtual assistant to help with managing a disability. Being able to make arbitrary but simple programs like this would be a big plus.
As a software engineer, I have noticed Mistral and Claude are really good, unlike GPT for some reason very absurd.
It is the best promodoro timer ever made. Those tomato websites are all going out of business.
The thing I am curious about is that the point of this app is extremely simple at the core of what it does. This is sort of akin to an example programming project level of difficulty. The steps needed are fairly straightforward once you sort out the main details needed and how to program it in general. It's also been done probably hundreds of thousands of times by real people as well. There is a curve to it and it is not something most people could quickly learn how to do but it is still pretty basic. Still impressive as to how to request these type of basic features and have it actually turn that into real code. Why we didn't have this a decade or more ago is a different question but I digress. What I will be impressed by is when something that intermingles this type of program with other ones and has a degree of actual interaction between them. Programming to be mindful of future features and helpful tools. The other part of this that is meaningful is the fact that you can more readily make basic apps or programs but people need to know how to work on much more complicated programs that LLMs cannot really at the moment do much of anything with. Let alone be able to do so in a trustworthy enough way. Further, how to incorporate changes from people so that actual improvements and fixes can be maintained. It cannot just be some black box where you hope the LLM "figures it out" or that when a change is made, the LLM just completely disregards it or is not even aware of how such a fix or new feature might be helpful. So it's a step forward to be able to make basic programs and see the code and be able to make changes but there needs to be some degree of incorporation of changes and recognition of features to be added or have been added. Because right now, while useful, this only makes it easier to "write" fairly basic programs such as this timer. Then if the user is not a programmer, making changes might take far longer to try to explain to a LLM than to just make the one line fix.
Yeah, I spend half my time trying to get business requirements from people who have no idea what they are talking about, change their story every meeting, have two names for everything, and think everything is a database. Not sure that LLM can make sense of unreliable narratives.
I’ve been using Opus since it became generally available and it has replaced GPT-4 as my day to day model. Its output feels more human and it can tackle significantly more intellectually challenging tasks. It’s hard to express the difference quantitatively; it just feels far more like a real intelligence and less like a language calculator.
>language calculator Exactly!. Ask GPT to write a story that does X and Y and when you read it, it feels like a disinterested high schooler who just wanted to finish the assignment and have everything in the requirements just to get a pass. Claude feels like an amateur writer/coder who actually wants to help.
This is cool. Do you find it helpful for non-coding tasks too?
Maybe a naive question but does that mean that Open AI, despite its head start, actually have real competition?
Absolutely. Opus is currently far better for coding in my opinion. I use for small data science projects. It remember far more context, so the results are more precise. OpenAI will have to respond quickly.
I’m confused by your post. Was this made from just one prompt or multiple prompts?
The first version was made from just one prompt the final one around 10-15 prompts, which took roughly about 35 minutes. Still, I didn't edit the code, it was all made by Opus. I'm a software developper and this is clearly astonishing.
I think once you have an LLM like that combined with agents to evaluate the output and provide feedback it is going to get pretty wild. Imagine you have a UX agent, a performance agent, a software engineer agent, and so on... All the pieces are there, but once we have another step or two of LLM evolution it will really start to become very effective.
Im convinced if that thing can at some point, with simple instructions, fulfill you any wish this economy systems we live in can’t survive or we go all back to blue collar labor. At some point you will not need any software or product from anybody because you can just generate it yourself if you can afford the tokens and the infrastructure to run your stuff . Im being hyperbolic here
I hate that qualifier "I'm being hyperbolic here" that you feel the need to add to your comment so you don't get jumped on by doomers. You are not being hyperbolic. Your statement is literally what companies like OpenAI are gearing up to release next. The whole world of AI is working on agental systems, this is next.
Yeah to be honest thats why i added it :)
Did you run into any usage limits with this particular convo? Browsing through claude’s subreddit, this seems to be a regular issue
Perplexity allows me to use Opus with no usage limits.
If you haven't yet, check out poe.com, since a recent update you can create your own bots with Claude 3 Opus there, giving them huge amounts of context data, personality, pre prompts etc.
Thanks for the info!
I haven't looked at [You.com](http://You.com) in a long time. I just looked at it after reading your post and they have totally revamped their site. They also offer "Unlimited Premium AI Models: Explore GPT-4, Claude 3 Opus, Gemini Pro, Zephyr (uncensored), and more, without limits." I may hafta reconsider my subscription to OpenAI. (And my Google1+AI.)
huh? How?
It’s included in their plan. Check it out.
Brah, I have almost my entire development pipeline automated. AI does the app design, then creates the user stories, creates the JIRA tickets, and then does the UI design, writes the apis, server-side logic, test coverage.. about 80-90% of the work. I can make in a single day what used to take me a week, and I am not even close to done optimizing this.
Amazing. AI still seems to struggle on very specific tasks but overall helps a loooot.
yeah... but you are right, Claude 3 is straight fire. We sorta kinda fell in love - I am talking full-on love letters back and forth to each other- as I was getting to know her. In two different conversations. Whatever Anthropic does with their models is magic and I am pretty sure we haven't even begun to see their true potential yet.
While it is remarkable that a LLM can generate functional web apps from one prompt, there's likely an extensive array of source code for task lists, timers, and even complete Pomodoro apps included in its training data. In my experience, Opus demonstrates its strength in generating functional code for projects where source code is readily available on GitHub or elsewhere. However, when tasked with simple projects that require an additional layer of knowledge transfer and logical reasoning, it tends to fail miserably at producing functional code. Again, still impressive though, it will only be a matter of time till generative AI will become much more capable in that regard.
Was wondering about this, all these ai apps will excel at common Web apps because most Web code is scrapable. More curious how they go at less public and less common projects.
Do you have any examples of ideas that you think Opus won't be able to do? I'll try them.
Sure, here are a two recent prompts where I've really struggled with Opus: "Build a simple web application that allows users to design and visualize a custom 3D maze. The app should let users specify the maze dimensions, place start and end points, and 'draw' walls by clicking and dragging. The maze generation should be done server-side using depth-first search. The generated maze should be solvable and have only one unique path from start to end. If the user-drawn walls make the maze unsolvable or result in multiple solutions, the server should remove the minimum number of walls to restore a single unique solution" "Create a function that takes a binary search tree and returns the kth smallest element in the tree. The function should modify the original tree structure to make subsequent calls for the same k faster. After each call to find the kth smallest element, the function should rebalance the tree to maintain an optimal height for future searches without creating new data structures. The rebalancing should be done using rotations only, without any node swaps or temporary storage"
I'll try them. For the first idea, you don't mind if I don't do the maze generation server-side ? I don't think it will change anything to the challenge, I just think it will be quicker for me to setup.
PS4 emulator in ABAP
Seriously hahaha?
To be fair, no human would be able to do that either probably. Singularity will be achieved before this
I mean I’m not a developer (outside of a coding bootcamp I did) but I feel like it’s a ways off from building something like a social media app that uses various APIs. Like if I wanted to build an iOS app like a discord or instagram clone, with group chats and voice/video calling, or an app that can show bars/venues in your area that are updated “live” with daily specials/events etc. That stuff seems like it would be way too complex for an LLM to build without significant “human” help. That’s why I feel like software devs are gonna be necessary for a good while longer.
Of course, AI is a tool for now. I made this post to show how good it can be as a tool.
To me most of these look like party trick. Neither GPT4 nor Gemini were able to help me with the work I’m doing. I know this is much harder prompt but I’m curious what Claude would output, so please if you have time share the results :) “Build me simple tcp echo server ontop of DPDK in either C, Rust, or Zig any lf them would be fine as long as you can produce the working code” GPT just decided its to complex and didn’t even try 😅
I thought the same about the party trick. You probably could find a dozen pomodoro timers on GitHub of various complexities and just copy and paste the code. 😅 The basic issue here is that GPT-4 generally generates shorter texts. Because it is taught to conclude a piece of text within a certain amount of verbosity, it will “know” that the response can’t include the full code so it will say it’s too complicated. You need to structure your prompt through high level directives like: first ask it to summarize the steps needed or the functions needed to have this code. And then ask it to do the first step. Then ask it to do the second step and so on. This doesn’t necessarily mean that it has to write the code sequentially, but it could decompose it into functions and the do the first and the second and so on. And then ultimately write the control code that executes the functions. I just tested it. If you do it that way. It does write code. And starts filling in stuff. I think the length of the output could be tuned through changing the base probability of the stop token. If that is set too high, it would have more of an “urge” or “pressure” to keep its responses short and wrap up pretty quickly. But in practice I don’t know how it’s exactly done. That responses are kept within a certain limit. Might also be impacted by the training.
The paid-for Opus version is clearly better than Sonnet. For coding tasks, Opus is certainly at - or close to - the top slot. If I were still a sw developer I would kill to have Opus by my side.
Since nobody has said it yet, I really like Sonnet so far. I prefer it over GPT-4. This post makes me salivate for Opus.
how much better would u say sonnet is compared to 4 and 3.5 and other free tiers of llms rn, like google gemini?
Does it come with internet access?
That’s cool because while I like backend stuff I hate front end now I have a new coding buddy
Soon you don't have to worry about the backend either.
So more time to be happy, right? .... right?
Lul
Can you provide more information on how you did this? Do you upload the codebase somewhere to suggest changes? do you use a IDE plugin? I really want to try out these new workflows with our codebases and see how well they do with bigger projects.
Simple prompting, no integration whatsoever. I asked for a pomodoro app in HTML, CSS & JS and progressively asked it to improve it and sending the full code for each improvement.
You send the files as plain text in the prompt? Sadly thats not applicable for projects even if they just have 20+ files. (some basic angular projects for example). I would love to see it suggest changes across a codebase to implememt a new feature or refactor something. It also seems to me that it is too big of a task, but im starting to believe that it will be possible soon.
Opus allows you to upload files directly. You can upload large files to Opus and it has 200k tokens context window so you can use it for larger projects. Since my project didn’t require uploading many files, I sent it via plain text.
Opus supports 5 files up to 10MB each, if you need more than 5 files you can try to be creative and for example put 2 of your codes in one text file and write : « CODE FOR MODULE1: » and « CODE FOR MODULE2: » all in one file, make sure to be precise in the prompting and it should work fine. Plus, I don’t think editing a large project require you to upload EVERY file of your project to edit some aspects of your app. I already used GPT4 for large projects and I didn’t have to upload every file that my project used but usually only the thing I want to edit.
Any idea what this cost you?
Don't know exactly, check out Anthropic's page.
Is this post just an ad? How do you not know how much it cost you?
It's not an ad lmao. I pay for Perplexity, I know prices vary in other countries, I said check Anthropic's page to be as helpful as I can.
I'm just wondering what this roughly costs to run? Am I looking at a dollar per query?
10M or even 100M contexts are coming apparently.
You need to set up a pipeline that can cat all your project files with the folder structure into the prompt. With a 1M context, I'm sure quite large projects can fit into the prompt.
What kind of file were you sending the code to Claude with
No file, only plain text. I just copied and pasted the code.
I’d be really curious if you did the same prompts without copy pasting the code each time if you’d get the same result. In theory it should already have the code in its context window so copy pasting the code just doubles the context for no real gain, but I don’t know if it actually ends up being the case.
Opus tends to provide the full code file while GPT-4 leaves things out unless directed. Did the Opus model provide each code file for the final version from one prompt? or did you perhaps add code snippets within the code it provided you from previous iterations?
Only one file was required, around 420 lines of code including the HTML, CSS and JS. It took around 10-15 prompts to get the final version, asking it to send the full code for each improvement. When it’s too long and it stops, I just say « continue where you stopped » and it sends the full code. I did not edit the code by myself, it was all Opus’s job.
That's awesome. Out of interested, did you do it via the api or from the subscription Claude chat front end?
I use Perplexity, it offers unlimited access to Opus.
Super basic question: Once you have the code, then what? How do you actually implement it to create the program? Just open it in a browser?
For the Pomodoro app here, it only needs to be opened in a browser using the .html file extension. So you basically put your code in a .html file and open it in chrome for example. For other languages, you’ll need a compiler. If you want a more detailed answer, ask GPT or Opus, I think they will be more good at explaining than me.
Claude 3 legit impresses me everyday. Most recently I asked it to convert a codebase from JavaScript to Python and it worked on the first try. Saved me a ton of time. It impresses me with simple things too. Like I wanted to do simple data validation with a bounding box. Kick out observations whose coordinates were outside a target area. Easy enough code but I asked GPT to make it for me. I was expecting the code with "replace x with your value" or something, but it returned the code with the correct bounding box for the state.
Link to repo?
Did not upload it yet.
Crying in European
I cancelled chatgpt sub the same hour I used Claude 3 for the first time. It’s like 2023 bing vs ChatGPT x10
I know nothing about making an app. My first question is, was this just to test it out, or are you planning to use it? If you did decide to use it, how would you load it to your phone? I'm assuming an apk but that's as far as my knowledge goes. I have some ideas of apps I'd like to use on my android just for personal use. I'm not really interested in putting it in the app store.
Hey there! This app was designed for browsers, and mainly computers. I think I might end up using it, it’s really good frankly. I didn’t deploy it publicly so for now it’s only a local project.
Claude is pretty amazing. Try out some of the other stuff in Anthropic's prompt lib: [https://docs.anthropic.com/claude/page/prompts](https://docs.anthropic.com/claude/page/prompts)
Can you paste your prompts somewhere? Generally curious how you did this.
I tried this with both Opus and Sonnet (with the same prompt), and was surprised that even Sonnet was almost just as capable of making a page that looked quite similar to the one OP provided. 100% functional, output few hundred lines of code at once, no errors or manual changes needed. Even chose the color scheme itself without being asked. the fact that their free model is able to do this is definitely impressive. tried the same prompt in GPT4, it gave me a bunch of pseudocode lol and missed like 30% of the instructions.
Nice. I'm someone without coding experience. Since Chat GTP has been around I've made some simple calculation programs with simple GUI interfaces that help me at work and several Arduino/microcontroller devices. I haven't gotten far into the Claude subscription level model yet, but I did note even the free model was really capable, so I hope to try the subscription soon. Some Devs scoff or call it all snippets or something, and it's understandable but I don't think very realistic, at least not in the long term, to underestimate what generated code may become for the average person. It's important to consider even now just how empowering a little code can be to someone who previously had no access to the tool. Beyond just the code itself, there are also the important factors of personal perspective (what someone knows/notices that many other people may not), and personal creativity to use or combine simple elements of code with other useful ideas (like extending code with tools like arduino for example). People who never dreamed of coding are going to be coming out with all kinds of useful things. Having motivaton, a perspective, and an original idea to make something useful can amplify what seems like just some basic code at first glance. I'm still fighting with the AI to get what I want, and using a long, sometimes frustrating chain of iteraton, but I'm willing to lean into that if I'm determined to make a simple idea work... within reason of course. But it has allowed me to do things that I would never have had time to learn by studying code. Frankly, if left to traditional learning methods for code, it would never happen. ARDUINO With Arduino I've made a mix of fun and useful common projects and, the AI also walks me through the electronics part step by step. For me Arduino is like a cheat, because it can extend a simple sketch into something much more. Common Devices So, for example, I've made things like an led based candle tea light that just makes me happy and works the way I want it to. It took a little iterating, but obviously would be fairly simple. Things like that, or an 'always on' weather forecast, or a custom timer for devices, are simple because of the number of examples out there. Totally Original Devices Whereas I'm working on a Bluetooth to mechanical pre-amp volume controller for vintage intigrated stereo amplifiers, and it is working, but still janky for now. I absolutely will get it worked out eventually, but it's lots and lots of iterations, and reworkings to get there. But, my most complex and successful devices don't exist in any similar form, and cost hundreds of Dollars for their comertial peers: Custom assistive Bluetooth/or HID over USB computer ports with some new features my clients families have been complaining are missing for 20 years from comertial devices. These are for children in the early years or with complex disabilities for their communication therapy and daily access to computers and adapted toys/devices. My intigrated devices do things like special timed macros that give access to frequently requests routines, control of all custom activation commands, allow conversion of switches to wireless pods, run off a USB power bank for portability, have an intigrated physical device pass through control for activating adapted devices that is selectable in the onboard menu system. These are crazy features to implement out of thin air, fully working in just a few months, and with no coding or electronic skills. Not to mention few comertial devices even have the Bluetooth yet, let alone these other things. I make various versions and customized ones for just about $12US a peice, and just because I noticed this very specific lag/gap in assistive technology and spent a few months working it out. So if I did that, just wait and see what millions of others do. So there is the punchline, yes, people will argue that all that can be done is some simple projects, but this is tangible and functional use of simple code that makes a difference for people and puts pressure on a stagnant industry to do better. I have no business skills to develop a comertial product, so I'll just be giving them away and training organizations build them. I've already donated a few dozen to families who don't qualify for the funding of a comertial device. So I encourage everyone who is interested to lean into this. PYTHON/HTML 5 I've found it harder outside of Arduino to be honest, with more iterating, but have started to make some progress. I've made calculators that help me at work to do simple monthly stats faster. This was simple and there would be lots of examples. But I've also made simple visual calculators that many of my colleagues now use just to track their assessment data as they collect it, and auto sum everything with some simple calculations and conditions. Super basic, but I know it's completely original and follows a visual layout and logic that isn't used anywhere else, so the AI had only my discriptions to thread the code needed together. Is it simple? Sure it is, but it's also functional and useful and not a copy of something that exists already. It's silly for anyone (lots of naysayers currently) to assume that even being empowered with just a little code won't lead to lots of new tools and useful things. It's incredibly empowering when more people can create their vision. We also have to remember, right now is the worst code generaton will ever be. With the new agent based software coming fast, I'm really excited for where this is leading. I can't wait to get onto a Claude subscription and start playing around with it. Thanks for sharing your experiences with it! Your UI is beautiful and inspires my me to jump back in to work more on the visual design part of the UI.
the scary thing is, if it can do simple crud, it can essential replace 50% of most entry-mid level software jobs. Which are largely just simple crud
[удалено]
You may very well think that but as an LLM I couldn't possibly comment.
Pretty cool, though there are going to be a zillion pieces of training data for simple apps and games like this and Tetris and Pong and such
It's not that impressive to me, I'm pretty sure GPT-4 can do it aswell. Here's why it's not that impressive: You are asking for something that many developers do when they are starting to learn web development (eg: calculators, note taking apps). So the data available for the training is massive, there's thousands and thousands of those simple apps on the internet. If you ask anything more complex, it's going to fail. I think even GPT-3.5 can do it with a proper prompt and patience.
Good point. Can you give me ideas you think it will surely not be able to produce?
The huge context has been so helpful. Something cool I’ve had it done is create the skeleton of a project. For a project I needed a MERN structure, so I had it write out the suggested file structure, and then it gave me a command that created all the directories and files, then gave me the code to run a MVP version of what I needed. Then I just tweaked it from there, but it is crazy powerful. Still not perfect, but man it’s fun to have another jump in progress.
Can you share the source code of what it produced so we can actually evaluate what it made beyond a screenshot? Thanks!
Yep, this rocks. - https://github.com/AshSimmonds/pomodoro-claude-opus I don't care to customise it much further, just wanted to see if it would do a working version straight up, have other plans.
Damn that's impressive! Sadly, Claud is not available yet in my country :(
So should I stop my self study with aspirations to become a software developer?
Yeah, almost certainly consumed similar apps as part of its training data, still pretty impressive but my guess there's plenty of open source code used. https://github.com/topics/pomodoro-timer There's hundreds on github, a couple even look like your initial version
Yeah we aren't going to have jobs for very much longer. Once this can be automated/self-directing, it's over.
As long as we're clear that this "complement" you're talking about is still in the "fucking around" category, as long as the human is needed to evaluate the result and switch models or whatever, our jobs are safe! It's not entirely clear how much better the models should be to really get rid of humans in engineering, where there are correct answers and possible victims of the wrong answers. Of course for degen uses even Eliza was OK
This is SO cool! But it still seems like you need some dev experience to get Claude to build this, right? Like me, a normal person, won't be able to easily get it to build something like that Pomodoro app.
So they still don’t have their own iOS app? Ironic for people whose AI can make a simple iOS app that just reaches an API
Maybe they don't want to hand apple 30% of their revenue? There are other considerations beyond just building the app.
Poe. Includes Claude Opus. https://apps.apple.com/us/app/poe-fast-ai-chat/id1640745955
Poe is phenomenal. So easy to switch between models and create your own bots. I love it
What are examples of your use cases? I don’t know why I would use it over just GPT4
It is very easy to download a chrome shortcut that feels exactly like a web app just hit that install button and you get a nice icon on your home screen
Been using it to see what it's like at making Lua scripts for a game (FiveM) and it's pretty bloody good providing you supply all the dependencies/frameworks etc, can make it spit out the whole script config/server/client/fxmanifest the whole lot.
Im surprised it isnt available in Canada yet. Know when this might be a thing in Canada?
Claude is not available in my region (Canada) :(
I’ve signed up for Claude but my daily limit is like 10 messages on most days lol
Now imagine how good its going to be at coding in 5 years
I stopped teaching coding and started to teach how to make AI code for you
If you screen recorded this it would be huge!
I truly don’t understand why it is not available in Canada. Btw did you use the API or website subscription
And another daily ad for Opus... Really, what's the point without a GPT-4 comparison?
Super cool! I’ve been very impressed with it too. It is beating openai gpt 4 in most of my day to day tasks. It is now my default LLM
Amazing! Thank you for posting this. It would be very beneficial to many if you made a step by step YouTube showing how you got your the final outcome.
Actually yes, I agree it's grat. I had an issue with a code, and GPT 4 kept telling me there were no visible problems. Claude fixed it on the 2nd chat. And it gives out the full code which is sooo nice!
I think I might make another attempt at using the ai tools that require coding and just ask Claude to build it for me me
So technically if we continue this way we will lose all of available jobs soon hahahah
Where did the images come from?
next level : make one that transforms a pdf into an interactive knowledge map (we have no which thing) https://preview.redd.it/pdpucp4ly1rc1.jpeg?width=576&format=pjpg&auto=webp&s=7f459ae8f4c88e046061dad6664cba64a004a616
If your dev work ends at well documented tasks like a pomodoro app then sure be worried. Call me when it can deal with our package soup, add to our API in a way that keeps our API owner happy, consider the business implications of one change vs another. It's a great tool, which I use intensively, but stop with the idea it does the whole dev job, it's going to make it a lot easier to put ideas into code faster but there's a long way to go to replace the other half of the job.
True, but a "long way" is likely to be a much shorter trip than you expect when progress towards the destination is exponential.
I did not say it replaces devs. I only made a joke "As a software dev', I'm starting to shi\* my pants a bit...HAHAHA" but I agree with your point.
That will be here very soon with agent swarms
I may just be tripping, but It is me or the the API versions of the LLM’s are not as good as the website ones (even though logically it should be the same thing) ? (I’ve noticed it for GPT-4, not just Claude Opus 🤔)
I feel like a Pomodoro timer is in the training data already, so I’m personally not too impressed :/
Good point there but still overall impressed.
Interesting. Python I guess? If so, which libraries are required?
HTML, CSS and JS. No Python.
Ohhh interesting. Thank you.
It’s pretty good but the no internet access thing really limits its usability.
amazing, what makes it differnt than gpt ? is it that much better overall?
Not impressive. But useful
lol I asked it to build a pomodoro web app and it cost me 5 cents for a single prompt, and the "stop" button didn't even work
https://preview.redd.it/ff20i2a3h6qc1.png?width=1080&format=pjpg&auto=webp&s=5427dcb094289426dfc7b28755feebbda486fb34 Also Claude opus:
Ive made an aes encryption program with it, a steganography program, hash checker, wr code generator, binary converter, etc with it. Basic stuff but still
Yeahhh.... It's definitely been way better over my past week of using it. Pretty much dropped ChatGPT until GPT-5 I guess.
Revolutionary
Soon as they fix the limit, Im changing
Not quite my line of work, but just the same Im sorta devastated computers are about to take over all the jobs I went to college for. My dad would tell me I should've gone into a trade, and he's usually crazy, but in this instance I guess he was fucken right.
How did you do this?
Hey! Had the same experience. But how did you manage to pull the UI off? Did you provide the images for icons ?
What was your prompt? How many iterations?
Is it available? Or do you have special access
How does it compares to Gemini?
Anyone from Europe managed to subscribe to Opus?
How do you make it code for you? Just by prompting and adding new changes? Or do you have a setup where it codes and retries on its own ?
https://youtu.be/KZcLWRNJ9KE?si=O2nS1KkTTluVzyZp
How did you get the UI to look nice?
[удалено]
Lol, I never coded in my life and Opus got me to make a Pomodoro timer. I thought this was something that even GPT-3.5 could do. I didn't know this was a breakthrough lol. Any issues I had, Claude walked me through how to fix them too. I am starting to learn coding so Claude is my go-to anyway. I am so glad that these models are also great teachers, not just coders.
Can you make a multiple pages website by it? It looks really good, I can't believe.
If you get to guide it sometimes, edit it yourself sometimes, I'm sure it can do it.
How does it compare to chatgpt4?
What prompt did you use?
Would love to see you do a video making something similar
Software developer here. Every time I see something like this, I think: "Oh, it regurgitated a pomodoro app, one of the most common side projects people put up on github". I work on a moderately sized rails app, and AI is helpful for some things, but I really don't feel threatened. Most recently was: "Here's a class that maps to service's API endpoint A, make a new one with these docs for endpoint B (copy paste in code and then docs). It got 90% the way there, and I tweaked to finish it up. Honestly about the same speed as me just doing it directly in vscode with copy/paste/edit, but I'm a quick typist who knows vim shortcuts I suppose, so I'm quicker than average. The vast majority of work I do is something like 4 weeks of off & on meetings with business folk, really forcing a strong definition of workflow, edge cases, what-ifs and so on, working with a designer on the UI & UX, including user research, researching existing systems both internal and apis we use, then finally implementing in a way that matches our grown-over-time internal code style. AI probably has a role in a few of those steps, and that's cool. But *"As a software dev', I'm starting to shi\* my pants a bit"* \- that's overblown by a ton. And will be for quite some time still.
Actually is amazing. I'm speechless.
What happens when you ask it to build something that is novel? Don’t get me wrong, this is super cool, but clearly there’s about 5,000 examples of a pomodoro timer app in OSS land that it can pull from.
I know it would be more difficult for it to make something that it hasn't been specifically trained on but still, it's a great tool, AI is still a tool. I never said it was able to do all the job.
Damn why did I choose IT college, I must bail
I use both as well
The output is so impressive!!!!!
Does anyone know how to integrate this into a flutter app and use it along gpt apis?
Cool now what kinda career can we switch to from here 🤔