Automated Testing Software

Although the platform does well for us, but i would mention few things that can be improved,

a) Dashboard Analytics - Would be better to have more detailed reports generated with smarter insights?

b) Emulators are good but real devices are the deal. Review collected by and hosted on G2.com.

Earlier we were relying on our own device farm and in house infra setup of machines and managed them to run automated tests serially. However, it was a taxing approach for us. We had to constantly manage and monitor the infrastructure and our DevOps team was already having their hands full. Plus, the addition of more devices meant spending more money. We realized we couldn’t scale this way. That’s what made us switch to LambdaTest. The cloud solution offered by LambdaTest helped us save time and effort. Parallel testing allowed us to scale as we needed.Without a doubt LambdaTest, helped us with faster deployment cycle and a better team collaboration! Review collected by and hosted on G2.com.

As a complete package, I don't think that there are any cons of this amazing software. But yeah sometimes it may take time on first time loading. Review collected by and hosted on G2.com.

I would like to highly recommend this software for developers/teams who are trying to build some API's or test them in an efficient and smooth way. Review collected by and hosted on G2.com.

We are creating and testing REST HTTP services for our newly developed web application, to be more specific we initiated with ngrok service, and all the routes can be tested easily with proper logging and debugging via looking at error log too if required. Review collected by and hosted on G2.com.

Semaphore v2 is still somewhat of a young product and as such there are a few rough spots in terms of features, but they are not nearly enough to make me reconsider using the product as it is today.

Specifically, I found the following things to be a bit rough:

* The artifact tool is a bit tricky, sometimes getting tripped up on certain filenames and not restoring a file to its original location. Fairly easy to work around, but more work than it should be.

* No high-level project health dashboard like we had in Semaphore v1 (or pretty much any tool). We can make dashboards, but they are all very commit-centric which doesn't work as well for managers and architects that just want to keep an eye on the basics

* The permissions model is very rudimentary, and this is a bit of a problem for more security-minded folks. For example, it's not possible to control access to secrets or who can manually deploy code to production. We rely on Github to keep us out of trouble, but I feel like this needs some more development.

* I'm not crazy about all secrets being global - the Semaphore v1 model (global + project secrets) was better IMO for managing large numbers of projects.

* It's not possible to parameterize manual runs. Though best case you don't need this sort of thing in a well-designed CI/CD pipeline, occasionally it's useful for things like hotfixes or rollbacks - exceptional circumstances.

* I can't seem to find a way to navigate the build history for a branch, i.e. scroll through a list of all the commits in order. This is a missing feature that other tools have

* If a pipeline is Stopped abnormally (i.e. neither Passes nor Failed), I have no information to tell me why. I probably should be able to see this info. Review collected by and hosted on G2.com.

Have worked at two companies now using Semaphore to build out pipelines for new AWS serverless projects. The main outputs of this are:

1) We have a hands-off CI/CD solution that Just Works. It requires no dedicated staff to maintain and extending our pipelines (or making new ones) is very easy. Drama-free.

2) It's a great educational tool. It's hard to learn what you need to do to make a solid pipeline fi you've never done it before and often find myself on teams where that's the case. Semaphore is not only a great tool for *building* pipelines, it's also a great tool for teaching people how to build them. The visual pipeline view alone is worth its weight.

3) It is incredibly cost-effective to run Semaphore, for the same reasons it's cost-effective to run serverless - you don't pay for idle. Review collected by and hosted on G2.com.

I do find some of the users are still a little confused when they try to click through prototypes. Review collected by and hosted on G2.com.

Do it! The insights are worth it. Review collected by and hosted on G2.com.

We're learning more about how users approach the tools we supply them and whether upcoming features/changes have good qual feedback. It's been really great as we update our understanding and experiences according to the feedback we get. Review collected by and hosted on G2.com.

I have no issues with Flosum, its a great software and I was pleasure to take the trainnings and certification exams.

I have no issues with Flosum, its a great software and I was pleasure to take the trainnings and certification exams.

Control all the changes, through this software. Control all the changes, through this software.

Control all the changes, through this software.

Control all the changes, through this software. Control all the changes, through this software.

Control all the changes, through this software.

Control all the changes, through this software. Control all the changes, through this software.

Control all the changes, through this software. Review collected by and hosted on G2.com.

If you want to Delivers and working with DevOps, you need Flosum! Review collected by and hosted on G2.com.

Control all the changes, through this software. Control all the changes, through this software.

Control all the changes, through this software.

Amazing Software and Flosum's Team Support

Amazing Software and Flosum's Team Support

Control all the changes, through this software. Control all the changes, through this software.

Control all the changes, through this software.

Amazing Software and Flosum's Team Support

Control all the changes, through this software. Control all the changes, through this software.

Control all the changes, through this software.

Amazing Software and Flosum's Team Support Review collected by and hosted on G2.com.

Automated reporting of test rail is much to be desired. Ideally we should be able to get a much better picture with automated test case reporting. Review collected by and hosted on G2.com.

Tracking the health of release. We focus on all areas automated runs, manual testing including new feature, regression and system test. Review collected by and hosted on G2.com.

When I adopt a SAAS platform I would like to see myself using it for the long term. I would like to see a slightly cheaper option in the Pro level. Review collected by and hosted on G2.com.

Buddy will be a good choice for your project(s) and you will not regret it. Give it a try. Review collected by and hosted on G2.com.

With Buddy I don’t have to worry about FTPing my files every time I want to push up a change. Instead it’s very easy once I set up the pipeline. I feel like I can concentrate on developing more without worrying about how to get my code out there. Review collected by and hosted on G2.com.

Apparently Cypress does not provide security reports of its own operation to registered users in these facilities, which means a problem on a large scale, since we cannot verify said receipt of any operation in progress, being a point that harbors mistrust , in these processes of great importance, although most of the occasions its operations are guaranteed, without excluding that it must integrate more information to its interface. Review collected by and hosted on G2.com.

Cypress guarantees that the tests you carry out on the operating systems created in your developer organization are easier, more reliable and more practical to perform, thanks to its high-end technological tools that make these processes more flexible to execute in a business environment, allowing to personalize said promoted software, which is recommended, since it provides comfort in these areas of high work effort. Review collected by and hosted on G2.com.

We use this software to carry out constant tests in the life cycle of a particular product, and we can even customize it to an environment more adapted to the demands of a client, which is a great proportion to us since we provide a complex service to the needs presented by the operators of our platforms interested in the services and products we offer, with its personalized development system being useful to guarantee total satisfaction to each of the individuals we have. Review collected by and hosted on G2.com.

User Voice feedback to feature release process is too slow

Data Deployment feature is not satisfactory Review collected by and hosted on G2.com.

Improving Release Management

Tracking Test Coverage

Monitoring Org

Deployment Rollbacks

Static Code Analysis - Code Reviews Review collected by and hosted on G2.com.

I wish it were able to build faster. This isn't necessarily a problem with the system, but I'd like builds to be faster in the cloud than they would be on my developer desktops. Review collected by and hosted on G2.com.

If you're considering Bitrise, I'd suggest that you try it out. They have a generous trial program and a free offering as well. It's easy enough to setup for a simple build process to determine if it meets your needs. All in all, you could reasonably explore it within a few hours. Review collected by and hosted on G2.com.

Bitrise helps us solve the CI/CD pipeline for mobile development. Building on the developer desktop for every commit is too costly in resources and time. Bitrise helps us transfer this to the cloud where builds can happen in parallel and also get deployed automatically. Review collected by and hosted on G2.com.

It has some quirks around not being able to certain things which are limited by design. These are generally possible in a selenium coding environment but obviously take longer to create. also, it doesn't support flutter for mobile app testing.

The other major issue that we keep hitting is Ranorex requires access to the gui aspect of window. So unlike with Selenium, where you can to a degree continue to use your machine for other activites, it requires full control of your machine. This means your local machine (if running tests locally) will be redundant for the duration of your test run. The other issue relating to this is it seems to be a nightmare to actually get this working with Jenkins. The machine need to be run with a Jeenkins node but requires it to be a physical machine. We tried various virtual solutions but as our test pack is heavily image validation oriented is seems to be impossible to get a clean run on a virtual machine without spending thousands to create a real-like virtual machine (at which point its cheaper to buy a real machine).

another issue we are facing is multiple users working with Ranorex is a nightmare, doing code review, code completion etc. we always have a nightmare when it comes to code merge time, its usually the most scariest time know full well someone will likely loose all their work and we will have to rebuild the tests Review collected by and hosted on G2.com.

Great software and worth giving it a go to see if it meets your business requirements. Easy to learn and pick up for basic functionality. More complex task will require more knowledge and understanding of indepth coding Review collected by and hosted on G2.com.

Ranorex allows the Automation framework in line with manual testing during tight sprint cycles. We have succesfully managed to integrate it within our setup and got it running automation daily Review collected by and hosted on G2.com.

Sometimes when things go bump, they fail to notify me of the issue. Review collected by and hosted on G2.com.

I use them for the majority of my regression testing, I've got two web apps and four mobile apps, that's a lot of regression testing that needs to be done before a release, saves our company a lot of testing time. Review collected by and hosted on G2.com.

Some projects that eventually get canned are actually very good but since its outside of the public eye they just get forgotten and no chance that someone else takes over them and if you are planning to go job hunting since the commits are private that means that no exposure to potential employers. Review collected by and hosted on G2.com.

The public version of Gitlab is not bad, but there are better options, but the actual system can be mounted separately and work as a private repository for repositories, and that it is actually great in an enterprise. Review collected by and hosted on G2.com.

It is our internal tool for managing git projects before they go to GitHub Review collected by and hosted on G2.com.

Not much, if there is one thing they that has to be the better support for mobile testing. Review collected by and hosted on G2.com.

As explained in the what i like best, Provar is helping our client automate testing of Salesforce CRM application as its better and easy to adapt compared to any other tools in the market currently. Also the scripts created doesn't need much maintenance which is a huge differentiator compared to other tool as Saleforce.com release updates every quarter and they change the X-paths or the page layout a lot, since Provar work on the metadata concept, the scripts easily adapts to the changes hence benefitting by saving the time required for maintenance of the scripts. Review collected by and hosted on G2.com.

Sometimes they have a few bugs with their features, but their support team is always available and answeres quickly. Review collected by and hosted on G2.com.

Don't worry about it at all, this is truly a great product with a great team behind it. Review collected by and hosted on G2.com.

Great experience, easy to use, and it really works! if the SLA of your piece of software is important for you, then have no second thoughts regarding this great product and service. there's just no way you can reach this level of robustness and ease of use when developing your own Selenium-based framework. Review collected by and hosted on G2.com.

The lack of proper namespacing makes us a tiny bit uncomfortable with deployments. Anyone with the ability to configure or run a job can extract potentially sensitive credentials from the system. Review collected by and hosted on G2.com.

We use CircleCI to dynamically build and cache Docker containers while also testing our code and, when/if all tests pass, deploy directly to production. Knowing that a deployment only requires a merge means we can trust our system to update itself and focus instead on writing production code. Review collected by and hosted on G2.com.

Coming up with test data. Our company deals with a lot pf PII, so spending time making fake files can be a bit of a hassle, but that'd be the case with or without Rainforest. Review collected by and hosted on G2.com.

We're working into kicking off tests once developers are at a certain point, so the QAs don't have to manually go in and run tests while they're working on something, or after each sprint release. Review collected by and hosted on G2.com.

The paid version is quite expensive. The license model was improved - it formerly was per master and executors which could lead to architecture based on license. Today it is better, now based on users (logged in or committing to SCM) , but with high costs per user, which can lead to hight costs very fast or it might lead you to try to limit number of users or switch some projects back to open source Jenkins losing the clustering advantages for these teams.

Changes and bugfixes sometimes can take a long time if they are important for you but not relevant for (many) other customers. Review collected by and hosted on G2.com.

Jenkins, the de facto standard for CI, can be a lot more useful with the enterprise plugins and with the clustering option.

You can manage large projects or many teams and projects a lot better than with one large Jenkins (Jenkinstein) or with many small non-connected ones.

Refactoring is made easier by just moving directories/projects around in the cluster.

Jobs can run as if they were on one large Jenkins (i.e. trigger, copy artifacts etc.) Review collected by and hosted on G2.com.

It takes some practice for the real power of LaunchDarkly to "click" for everyone within your org. LaunchDarkly takes user context and targeting rules out of the code and into shared admin interfaces, democratizing these controls. It's a huge time saver and reduces friction between dev and product release cycles. This can be a huge paradigm shift for both dev teams and product managers in order to get it right. The LD team has amazing onboarding and training documents, demos and support staff. Don't miss out, use them to educate your teams early and often! Review collected by and hosted on G2.com.

1. Code releases ahead of product launches.

2. Demos and sales pitches of new features and products in PROD envs. for 3rd party partnerships. Safe, self service controls for QA, Product and Sales teams.

3. Permanent toggles states for different business channels leveraging common components with slight variations.

4. Wholesale UX flow changes to meet business cases and still maintaining DRY standards in our code. Review collected by and hosted on G2.com.