Pular para o conteúdo
← Back to Skalablog

Published article

5 Things the OpenAI Codex Agent Does Well and Poorly

Software EngineeringCodex vs Claude CodeOpenAICursorGitHub Copilot

The OpenAI Codex agent is a cloud-based software engineering tool that connects to your GitHub repository, executes coding tasks on its own, and returns a pull request for review. It handles small, annoying tasks well. Complex features still need a human steering an editor like Cursor.

What Is the OpenAI Codex Agent?

The OpenAI Codex agent is a cloud-based software engineering tool that OpenAI announced on May 16, 2025. You connect it to a GitHub repository, describe a task in a chat inside ChatGPT, and it works on the code in an isolated cloud container until the task finishes, then opens a pull request for your review.

The name can confuse people. OpenAI first shipped a tool called Codex as a local command-line client, which OpenAI documents separately as the Codex CLI. The CLI runs on your machine and works in a chat where you type instructions. The cloud agent announced in May 2025 reuses the concept but runs unattended: once you submit a task, it runs from start to finish without your input.

OpenAI also built a model tuned for this agent, called codex-1, which it reports as scoring better than its o3 model on internal coding evaluations in the launch announcement. That is vendor-reported benchmark evidence, not an independent measurement, and it says nothing about how the agent performs on your specific repository.

How Do You Set Up Codex on a Repository?

Setup happens inside ChatGPT under the Codex section. You create an environment, link a GitHub repository, and grant the requested permissions. The environment configuration decides how the agent can run your code.

Three setup choices matter in practice. Each one shapes what the agent can and cannot do with your project.

  • Pre-installed packages. You pick the runtime version your project needs, for example a specific Go version. Packages install inside the container before the agent starts.
  • Setup script. You can define commands that run at environment start, which is where you would install dependencies or prepare configuration.
  • Network restrictions. You can disable internet access entirely or allow only specific domains and HTTP methods, which OpenAI describes as a security control in its Codex documentation.

This sandboxed design is what makes unattended execution defensible: the agent works inside a container you scoped, against a repository you linked, with network access you defined.

What Happens When You Submit a Task?

Submitting a task is a two-step decision: choose how the agent runs, then wait. In the test session described below, the developer first asked Codex to analyze a Go rate limiter codebase and list potential bugs with explanations.

The workflow looked like this in practice:

  1. Describe the task in the Codex chat, for example: analyze the codebase and recommend improvements.

2. Choose run mode. One mode executes read-only analysis without writing code; another grants permission to modify files.

3. Wait. The agent works unattended. The initial codebase analysis finished in about 2 minutes.

4. Review results. The agent returns a list of findings, each with a description and an option to start a follow-up task that fixes it.

5. Delegate fixes. Starting a fix sends the agent off again; five fixes in the test took roughly 41 minutes of wall-clock time.

6. Create the pull request. When you are satisfied, Codex opens a PR on GitHub with a summary, the changed files, and a link back to the full task log.

During execution you are a spectator. You can watch the logs and see which commands the agent runs, but you cannot redirect it. It either finishes or fails, and only then do you get control back.

What Did a Real Test Find?

The hands-on evidence here comes from a developer who connected Codex to a Go rate limiter project on GitHub and ran both analysis and fix tasks. The agent found seven categories of issues, several of which were real code-quality problems a senior reviewer would flag.

The findings included a race condition in the in-memory storage when incrementing request counters, an unused timeout window option, incorrect handling of the forwarded client IP header, a missing license, a Go version mismatch, and an unused test dependency. The developer then started five fix tasks in parallel.

The fixes came back with visible diffs, new unit tests for the changed behavior, and targeted test runs covering only the code the agent touched. One integration test failed because it needed a Redis instance, which the container could not provide. That failure was an environment limitation, not a code defect, but the agent reported it plainly.

One quality complaint stands out: the generated pull request descriptions were thin. The PR carried a short summary and a link to the full explanation in Codex, so a reviewer who wants context in the PR itself has to click through. That is a workflow friction the agent's authors will need to address.

What Are Codex's Current Limitations?

The limits observed in testing fall into four groups. Each one affects when you should hand a task to Codex and when you should keep it in your editor.

No mid-task steering

Once a task starts, you cannot interject. With an editor like Cursor, developers routinely redirect the model halfway through. Codex removes that option by design. If the agent misunderstands the task, the only option is to wait or abort.

Container constraints

The sandbox has no Docker-in-Docker support, so the rate limiter's Redis-backed integration test could not run. Projects that depend on external services or nested containers will see test failures that are environmental, not real. Design your tasks around what fits inside the container.

Speed varies with task complexity

A 2-minute analysis is fast; 41 minutes for five fixes is not instant. Plan for tasks that take tens of minutes and batch small, independent fixes together.

Capability ceiling

The speaker's assessment, based on first-hand use, is that Codex handles small, well-scoped work: bug fixes, cleanups, missing tests. Complex, multi-file features still require a developer piloting a tool like Cursor or GitHub Copilot in the loop. OpenAI's own positioning of Codex as an assistant for parallel small tasks, in its May 2025 announcement, matches that experience.

Codex Compared With Other AI Coding Tools

Codex is not a replacement for the editors most developers already use; it occupies a different slot in the workflow. The distinction is who is in control while the code is written.

ToolControl modelBest fitAutonomy level
OpenAI Codex agentCloud agent, unattendedSmall bug fixes, cleanups, testsRuns to completion, PR output
Codex CLILocal terminal chatVibe coding, quick local editsInteractive, developer-driven
CursorAI-first editor on VS CodeFull features, heavy steeringDeveloper pilots every step
GitHub CopilotIn-editor assistantInline completion in VS CodeSuggests, developer accepts
WindsurfAgentic IDEAgentic flows inside an editorMixed, developer supervised
Claude CodeAnthropic terminal coding agentTerminal-based agentic tasksInteractive, developer-driven

The practical reading: keep your editor for anything requiring judgment and iteration, and route the small, disruptive tasks to Codex. Those small tasks are exactly the ones that break your focus mid-feature.

What Does This Mean for Developers?

The immediate shift is who does the chores. Small fixes that tech leads used to hand to junior developers, or that seniors postponed for days, can now go to an agent that returns a reviewed pull request. The developer's job moves toward reviewing, architecting, and deciding what is worth automating.

Two caveats keep this grounded. First, one successful test session on one repository does not prove Codex works everywhere; results depend on codebase structure, test infrastructure, and how clearly the task is described. Second, the review burden does not disappear. The speaker in the test skimmed the diffs without a deep review; in production, someone still has to own that code.

The durable skill is not prompting. It is knowing software architecture, delivery flow, and business context well enough to judge whether an agent's output is correct. Developers whose day consists mostly of the small, easily delegated tasks face the most pressure to move up that stack.

FAQ

  • Is the OpenAI Codex agent free to use? The article's testing does not establish pricing details. OpenAI bundles Codex with ChatGPT plans, but plan tiers and quotas change, so check the current Codex documentation before relying on any specific limit.
  • Can Codex develop a complete feature without help? Not reliably, based on the first-hand test described here. The agent handled small fixes and cleanups well, but complex features still need a developer piloting an editor like Cursor.
  • Why did a test fail inside Codex? In the tested project, a Redis integration test failed because the Codex container has no Docker-in-Docker support and cannot run nested services. Failures like this are environmental and do not indicate broken code.
  • Does Codex replace Cursor or GitHub Copilot? No. Codex runs unattended in the cloud and returns pull requests; Cursor and GitHub Copilot are interactive tools where the developer steers every step. They solve different parts of the workflow.
  • How long does a Codex task take? It varies with task complexity. In the test session, a codebase analysis took about 2 minutes while five parallel fix tasks took roughly 41 minutes. Plan for tens of minutes, not seconds.

Turn Your Own Videos Into Articles

This article started as a 25-minute video walkthrough of the Codex agent, and its most useful content was the specific test: the 2-minute analysis, the 41-minute fix batch, the Redis test that could not run. Written down, those details become searchable and quotable in a way a video rarely is.

If you have that kind of knowledge sitting in your own YouTube videos, Skala Blog turns it into a written article. Paste the video URL, get a transcription, and generate a structured draft you can review before publishing.

Source video