CodeRabbit Reviews & Product Details

I really appreciate how CodeRabbit significantly reduces the reliance on another developer in the code review process, allowing me to continue my work in minimal time. It gives me the confidence that my code does not include serious bugs and code smells, which is incredibly reassuring. I also enjoy its seamless integration with GitHub Actions, making it easier to respond to comments directly. The initial setup of CodeRabbit was very easy, which saved me a lot of time and effort. Review collected by and hosted on G2.com.

I find it problematic that, like other AI tools, sometimes CodeRabbit becomes unstoppable and generates useless comments. This can be frustrating and require additional effort to handle. Review collected by and hosted on G2.com.

The product itself has proven quite useful. It has already spotted a great number of issues that we definitely would not have spotted ourselves. We rely on it every single day.

It's pretty easy to get started and to customise the rules and settings on the online panel - although jumping between repo settings and org settings is a bit awkward UX-wise.

The sales and onboarding processes were very accommodating, even if a bit slow. Review collected by and hosted on G2.com.

By far the biggest downside of CodeRabbit is their customer support. They have a chatbot that only exists to pre-fill an email.

Despite the bot asking for my email address (which they already have on file), they sent the response to my request to our billing contact's email instead. When I pointed this out as a fairly glaring security lapse, their response completely ignored that. Further contacts went unanswered entirely. Review collected by and hosted on G2.com.

- It explains analyzed PRs with diagrams and detailed descriptions, which really helps to review them later and make sure that the code does exactly what was expected

- It provides good quality code reviews, detecting bugs, not optimal implementations, missing tests, and suggests improvements

- It learns from feedback and communication with humans and does next reviews better

- It saves PR reviewers a lot of time by checking all the prerequisites. Review collected by and hosted on G2.com.

- It is unstoppable in its suggestions, providing comments and change requests even to the code, it suggested in previous iterations, so the process can run forever

- It still makes mistakes, and even after I ask to verify the suggestion or the fix, it is going to post, before the posting, it still doesn't do that, so we need to run another iteration of our discussion to verify it and correct if needed. Review collected by and hosted on G2.com.

Surprisingly, CodeRabbit's PR summaries, auto generated diagrams and table providing an overview of changes in each file ended up being one of the most helpful things for our team. This was especially true in complicated PRs but also helped when team members reviewed code from projects they weren't as familiar with. Review collected by and hosted on G2.com.

For a larger team, we found that sometimes CodeRabbit's PR feedback was a bit too much and added to the noise of PR reviews, even when set to a lower frequency setting. For some projects, this detail was more useful (e.g. front end web) and for others less so (e.g. back end). Review collected by and hosted on G2.com.

I've been using code rabbit since the old days when it just used to be a GitHub action. Now it's a one step install GitHub app and it's become even more convenient.

Although I miss self hosting it, infact I still do a patched GitHub app from the old GitHub action, I can't sent that coderabbit has been awesome in adding new features and quality prompts/prompting techniques.

It really feels like the PR Review is there to help you, not just to say oh we got this cool this done by AI. Review collected by and hosted on G2.com.

I understand that it requires funds to run an org, but yeah, it's sad that coderabbit isn't mit or gpl anymore, though it's not that hard to make a GH app out of thier old GitHub actions, but I'd still recommend using their services since they improve so much so frequently. Review collected by and hosted on G2.com.

The review process has sped up greatly on my team. We less worry about nitpick comments manually and leave the reviewer up to reviewing the PR as a whole.

The automation here is great! Far deeper than I expected it to. Comittable comments are lovely. Review collected by and hosted on G2.com.

Only thing I can find is that there isn't a way to disable code review at an individual repo. I can edit lint rules and other settings. However I have some projects that I just don't care about automation and I would just rather have it skipped altogether. Review collected by and hosted on G2.com.

It's pretty good to maintain good code quality and prevent potential bugs, it catches them directly in the PR and even suggest code changes directly, saves tons of time. In case of false positive, you can easily tell it to ignore it next time and it'll keep it in mind for future PRs, same for code style, preferences, etc.. Pretty much anything Review collected by and hosted on G2.com.

Although it is pretty good and I'm 99% happy with what it suggests, it can happen that some times some suggestions arent that great or valuable, but this is an AI and it's pretty much to be expected, you can always easily discard them and let it know so it doesn't do it again. Review collected by and hosted on G2.com.

- easy to use, easy to converse with and interact with

- easy to implement Review collected by and hosted on G2.com.

I wish there was a progress meter or something when it is reviewing. Review collected by and hosted on G2.com.

We use it for almost every pull request in our company. Automatic reviews are great and of good quality. I love that you can talk to it directly by replying on the comment threads it creates on the pull requests, and also just ping it to explain a piece of code in the pull request. That way every reviewer can also see the explanation & walkthrough of the code. Review collected by and hosted on G2.com.

- I would like to have Global instructions rather than just path based instructions

- I don't like the setting to set the base branch, it doesn't work well with stacks where the base branch is not always master, so the subsequent PRs in the stack gets neglected. So I had to create a Graphite automation that automatically adds the `coderabbit` label when a PR is created, and my teammates have to add themselves into that Graphite automation if they want to opt in to get the automatic reviews for all their PRs regardless of the base branch.

- The web app is very laggy. It takes very long to load each page in CodeRabbit's app. It's good that I don't have to touch the web app much other than occassionally configuring settings, but I hate the wait when i have to do it. It also forces me to login everytime when i have already login before. Review collected by and hosted on G2.com.

When working on a project as a solo contributor, CodeRabbit gives you a "second set of eyes" to verify your work, and check for things as simple as spelling mistakes, to proper error handling, interface definition, and more. I especially appreciate how the github integration works seamlessly, allowing me to spend more time focusing on solving problems, and less time on tooling. It suggests test suites, which is wonderful for devs who don't have the capacity to write a thorough set of e2e tests from scratch. Best feature has to be that it's free for open-source projects, so I am able to deliver higher-quality code without taking on a financial burden. Finally, it also adjusts to feedback, so if it suggests something incorrect, you can refine its behaviour by responding with natural language. Review collected by and hosted on G2.com.

Some of the recommendations are nonsensical or just plain incorrect. At times, the suggested code changes result in a broken state. Overall, it's not a code author, so you cannot treat it as one - engage in a review process with it as if it were a junior developer who has a lot of knoweldge, but little practical experience, and you will probably find it of some use. Review collected by and hosted on G2.com.