We've Upgraded Our Recruitment Technology to Give You More Control + API Documentation and More

More Efficient Recruitment Technology

No one likes a tedious hiring process, but unfortunately, many technical recruiting tools don't provide sufficient automation, slowing down productivity for recruiters and hiring teams. For example, individually inviting each candidate to take a skills assessment, rather than being able to invite multiple candidates all at once.

This month, we've introduced a solution to make hiring more efficient, simplifying the way you invite candidates to showcase their skills in areas like DevOps, Cloud, and SRE.

Introducing: Single Invitation Links

With Brokee's latest update, hiring managers can now create a single invitation link for job-specific tests and share it with multiple candidates at once.

This feature cuts down the time spent on administrative tasks, allowing you to focus more on evaluating the talents that come your way. It's a straightforward, efficient approach to tech hiring, designed with both hiring teams and candidates in mind.

Benefits for Technical Recruiters & Hiring Teams

One of the biggest perks of this new feature is the sheer amount of time it saves. Instead of sending out invites one by one, you can now reach an entire pool of candidates with just one link. It's like opening a direct line between your company and potential talent, making the initial steps of recruitment smoother and faster for everyone involved.

It also creates a more candidate-friendly application process. When candidates have a hassle-free experience from the start, it sets a positive tone for the rest of the hiring process. Plus, we've found that most technical candidates care greatly about how technically advanced the hiring process is at the companies they are considering.

Control and Flexibility

In the recruitment process, having control is crucial, and our newest feature ensures that you're in the driver's seat. You can decide exactly how many candidates can take the test through the invitation link, allowing you to manage your recruitment budget effectively without compromising on the quality of your talent pool.

Whether you're looking to fill a single position or several, this feature gives you the flexibility to scale your search up or down, based on your current needs. This way, you'll have the right tools to find the right people, at the right time.

Read More: We Transformed Flatworld’s DevOps Vetting Process [Case Study]

How to Use the New Feature

Using Brokee's new invitation link feature is very straightforward. All you need to do is create an invitation link, add the role, assessment type, and number of candidates, and send the generated link!

With just a few clicks, you can generate a unique link for your job-specific test and share it across any platform you use to communicate with potential candidates.

Once you've filled the position or wish to pause the recruitment process, you can easily disable the link, ensuring no additional candidates will access the test until you're ready to hire again.

What's Coming Next

We're looking to add even more functionality to this feature. You'll soon be able to set an expiration date for your invitation links, providing another layer of control over your recruitment timeline.

We'll also give you the ability to adjust the number of candidates that can use the link, so you can seamlessly add more candidates without needing to create a new link.

As experienced hiring managers, we know the importance of providing you with all the tools you need to tailor your hiring process to your exact requirements.

Also Introducing: Test Preview and Quick Access

We've updated our navigation to make Brokee even easier to use. Upon logging in, you are greeted with access to core features – including 'Invite New Candidate' and 'See Tests in Action'. The latter allows you to view the testing process from the eyes of the candidates you're inviting, giving you special insights into the quality of your hiring process.

Our new candidate dashboard

Plus: New Diagrams for Clearer Test Instructions

To improve our tests' accessibility and clarity, Brokee has introduced diagrams alongside traditional text descriptions.

This initiative is especially beneficial for candidates who prefer visual explanations or face challenges with text instructions, such as dyslexia. By incorporating diagrams, we're making it easier for all engineers to understand the available infrastructure, furthering our commitment to inclusive and effective tech hiring.

Our skills assessment diagram was built with accessibility in mind.

Get Early Access to Our API Documentation!

We're thrilled to announce the initial release of Brokee's API documentation. It's a starting point for developers looking to integrate our skills assessment platform into their systems.

The first version covers the essentials, but we're aware it has room for improvement. We welcome your feedback as we refine and enhance the documentation. Your input is crucial for us to make the API more robust and user-friendly. Dive in, explore its capabilities, and let us know your thoughts!

Conclusion

Brokee's latest features mark a significant step forward in tech hiring: one-click invitations, improved recruiter dashboards, visual test diagrams for enhanced clarity, and accessible API documentation.

These updates will streamline the recruitment process, making it faster, more inclusive, and adaptable to your needs. We're dedicated to improving your hiring experience and eagerly await your feedback on these new functionalities. Explore what's new on Brokee and discover how we're evolving to help you hire the best tech talent more effectively.

Thank you for trusting Brokee with your tech recruitment needs. Let's continue to transform tech hiring together.

Read More: DevOps Assessments Streamlined EclecticIQ's Hiring Process [Case Study]

Introducing Pricing Plans and Free Trial for DevOps Tests

We're starting 2024 off with a bang! We are happy to announce our biggest product update yet: the release of payment plans with a free trial.

To make this a reality, we:

• Developed payment plans and integrated our platform with Stripe

• Opened sign-ups to the public

• Developed free tests specifically for the free trial

• Added team management

• Implemented a permissions system for various platform features based on payment plans

Let's start with the most exciting part - Free Tests!

Free Trial for (Easy) DevOps Tests

To showcase our platform without asking potential customers for credit card details, we designed several easy tests that can be taken free of charge.

Simply sign up on Brokee with a company name, and get quick access to a feature-limited free trial that allows new users to conduct 5 easy tests and manage 1 user, giving you a preview of our platform’s capabilities.

A Selection of our Free DevOps Tests

Once you get comfortable with the process, simply upgrade to any paid plan to send tests to more users and have access to more advanced tests.

What do we mean by advanced DevOps tests? We have environments where candidates can work with live systems deployed to major cloud providers and showcase their skills in real-time. We've found that live DevOps tests help avoid hiring risks more than relying on professional certifications or resumes.

Pricing Plans for DevOps Tests

Our payment plans are crafted with the understanding that every hiring team has its own set of unique needs. Whether you're a startup looking for flexibility or a large enterprise seeking comprehensive solutions, our plans are designed to suit a wide range of requirements.

Flexible System: Credits Rollover Each Month

At the core of our payment system is the credit model. Users can choose between buying a certain amount of credits upfront or opting for a monthly subscription that comes with 2 credits each month.

Test credits indicate how many hiring candidates can take skills assessments. Every time a candidate starts a test, 1 credit is deducted from the company's balance.

Our Growth Plan has one amazing feature: credits accumulate month-to-month if not used. So, no need to stress about paying for a product and not using it. The hiring process can be sporadic, so you can use rollover credits from less active months to hire confidently, without seeing a spike in your billing.

Read More: How Much Does Hiring DevOps Cost?: Hidden Costs of Your Hiring Pipeline

This system offers unparalleled flexibility – if you're on a Growth Plan and go over your credit limit, candidates can still continue taking skills assessments - you will be charged for the extra usage at the end of the month based on a tiered pricing model (the more tests that are used in a month, the cheaper they get).

Similarly, if you’re on an On-Demand Plan and run out of credits, you may simply buy more as needed.

Send as many invites as you'd like to candidates. You'll only get charged if they take the test.

Unlimited Candidate Test Invites

We wanted to mirror the natural hiring process when designing our payment plans. We've seen that when you're hiring engineers for a specific role, you often invite many candidates for a technical interview, but only some of them will show up.

With this idea in mind, Brokee allows you to invite an unlimited number of candidates to take a skills assessment, even though not all of them will actually take a test. This way, we charge customers based on the skills assessments that were started by candidates, not based on the number of invitations you send.

Add Multiple Admins for Team Management

When you're a small startup, one admin user might be enough for a testing platform. However, for tech recruiting firms or large hiring teams, you'll want to be able to provide access to multiple teammates. This is why we added basic team management to our paid plans to support bigger teams.

Right now, the only role is an admin user, but in the future, we'll add more roles with different levels of access.

Team Management Dashboard

Ready to Try Our Free DevOps Testing?

We developed Brokee's payment plans with a deep understanding of the unique challenges faced by tech hiring teams. We invite you to sign up for our free trial and experience firsthand how our platform can revolutionize your tech hiring process.

Now Providing DevOps Tests for all Major Cloud Providers

As 2023 is coming to an end, we are excited to share that the team at Brokee has achieved an important milestone – Providing skill assessments for all major Cloud providers - Azure, Amazon Web Services (AWS), and Google Cloud Platform (GCP). We also improved our method of notifying customers about the tests submitted by their candidates. 

Keep reading for a deeper dive into our new Azure assessments and other latest updates. Plus, jump to the bottom to read about what we have in store for next month (hint: free tests)!

Azure Skills Assessments

In November, we released two new tests for companies running their IT infrastructure on Azure cloud. These tests are to qualify Junior, Mid, and Senior-Level Cloud Engineers.

Considering how actively Azure is promoting their service and that they are offering free credits for startups, we expect many companies to take advantage of Azure’s cloud platform.

Introducing: Azure Tests

When creating cloud assessments – like our newest Azure tests –  we have to keep the following in mind:

• Ensuring each candidate has an isolated unit for their test, so no one can mess with the environment;

• Automating the creation and deletion of testing environments;

• Providing candidates the ability to easily log in to their test.

When it comes to setting up infrastructure to allow for automated creation and deletion of testing environments, it is never a simple task. In terms of the ease of cloud resource management, we learned that Azure falls somewhere between GCP and AWS.

I’ll explain what this means – On AWS, we have a granular set of permissions for each test, specifying in detail what candidates can and cannot do within the testing environment. 

Similarly, for GCP, we provide a separate project for every test, with broad permission inside the project, but with a set of guardrails to ensure candidates will stay within the bounds of the environment.

However, Azure has an unusual structure for managing access to cloud resources. They have completely separate User Management and Resource Management (servers, networks, etc.).

For resource management, Azure has ‘Resource Groups’, which allow you to create and delete a set of resources in one go. To create our Azure skills assessments, we used ‘Resource Groups’ to automate resource management and to create isolated units for each test.

Candidate Login Process

Another challenge we faced when creating the Azure tests, was simplifying the login process for candidates. For other tests like our CGP Assessments, candidates could just log in to the testing environment with their Brokee credentials. 

Although Azure has many different options for authentication to the Azure portal, unfortunately for us, most of them are geared toward collaboration with other businesses or for typical end-user applications. In our case, we needed an integration with our user database, and this wasn’t within our means. 

So, to overcome this obstacle, we settled on a simple approach of creating a temporary user for each test. We made it easy for candidates by pre-populating the username, so the candidate only has to provide an automatically generated password from the test description to access the test.

We Simplified Candidate Login for Accessing the Azure Testing Environment

Improved Test Submission Notifications

At the beginning of Brokee's development, our product was geared toward engineers. Most engineers communicate via Slack, so that is exactly where we sent test submission notifications. 

As we’ve grown, we realize that not everyone uses Slack, and configuring private Slack channels with test notifications is not the most scalable option. So, we decided it was due time to move to email notifications.

In November, we configured email notifications as a default notification method to inform clients when their candidates submit tests. Now when candidates finish a test, our clients will receive an email notification looking similar to the one below:

While we still may provide Slack notifications as an option, rather than creating private channels, we'll allow companies to provide a Webhook to send notifications to. We believe this automated approach will be a win-win for our clients and our team.

Other Updates at Brokee

This month, we worked on updating our backend services, improving our monitoring setup to resolve issues quicker, and most importantly - integrating payment infrastructure.

Brokee was given Congressional and State recognition this month for our economic impact in Nevada. We're happy to say that ever since we moved some operations to Reno, we've had an absolutely welcoming reception.

Finally, we've published new articles on the blog, that we believe will be insightful and interesting to any professionals or teams that hire DevOps (or plan to hire DevOps in 2024):

• Essential DevOps Statistics for 2024

• DevOps vs. Developer: Choosing the Right Engineer Ratio for Your Team

Coming Up in 2024

Want to reduce DevOps hiring costs? In 2024, will release a free trial plan allowing users to sign up with just their business email (no credit cards required!).

This way, you can enjoy Brokee without having to talk to a single human (or pay a dime!). What could be better, right? ;) Stay tuned for the details next month, and have a great holiday season!

We've Added New Tests: Kubernetes and GPC Tests

Since releasing our first test to assess cloud skills on Amazon Web Services, we knew we wanted to offer skills assessments for all the major Cloud providers. Lately, we've been working hard to do just that.

New DevOps Assessments Added to Our Testing Library

This month, we released two tests for Google Cloud: a short test for more junior engineers, and a more complex test tailored for mid to senior candidates.

We also decided to release an easier version of our most popular Kubernetes test that will provide quick validation of whether an engineer knows how to work with applications running on Kubernetes. This test was designed so it could be used by both software engineers and cloud engineers (DevOps, Cloud, SREs).

We added these junior-level assessments to our testing library because many of our clients expressed an interest in faster and easier skills assessments that would take only 15-20 min to complete, while still providing the same high-quality standard of assessing engineers' hands-on skills in certain technologies.

Read on to learn more about the new tests we are launching this month.

GCP Skills Assessments

Both Google Cloud Platform (GCP) tests provide candidates access to the Google Cloud console to work with cloud resources. Each candidate's test is created in a separate Google Cloud project, so their testing environment is completely isolated from others.

Introducing our new GCP Tests

Unlike AWS, Google Cloud doesn't allow the creation of usernames and passwords to access the GCP Console, so this means a candidate must have a Google account to log in to the GCP Console.

To overcome this limitation and to provide a seamless experience for candidates, we've implemented the Workforce Identity Federation. This allows candidates to use existing their Brokee credentials to log in to Google Cloud to complete skill tests.

This experience proved to be even more convenient than creating users on AWS, so in the future, we will attempt to achieve the same workflow for our AWS tests.

Similar to AWS and other tests on Brokee, hiring teams can still expect to receive the same detailed reports for each candidate. We will provide a history of user activity and AI summaries of the candidate's performance.

An example of a test report

Junior Kubernetes Assessment

Our most popular test for Kubernetes is often considered pretty difficult for mid-level - and even sometimes senior - applicants!

In addition to needing to know their way around Kubernetes (which is complex on its own), engineers need to understand how external-dns and cert-manager can be used together to automatically create DNS records and SSL certificates for the application running on Kubernetes.

We usually see one of three things when candidates take this test:

a) they solve the test completely in a reasonable time frame (1-2 hours),

b) they complete 70-80% but have a tough time

c) they can't do it at all.

Not all engineers who work with Kubernetes necessarily have (or need!) a deep understanding of Kubernetes administration. Some developers just need to be able to deploy simple applications, while their colleagues do Kubernetes administration.

This made us realize that a simpler test would be sufficient to filter out the majority of unqualified candidates, and checking core Kubernetes functionality would be more applicable to a wider pool of companies.

Introducing our Kubernetes Junior Test!...

We've launched our new K8s Junior Test

This test can be used for software developers or junior DevOps candidates (even though some would argue that there are no Juniors in DevOps 😈).

Candidates will fix configuration errors in a Kubernetes application to make it run correctly on the cluster. This should be a quick puzzle for those with at least some knowledge of Kubernetes.

---

Thank you for reading - we invite you to try out our new tests with your teammates or hiring candidates, and let us know what you think. What's coming up next month? We are developing skills assessments for Azure, stay tuned!

Read More: How to Choose the Best DevOps Engineer Assessment

We Offer an AI-Powered Technical Recruiting Tool

Our team had a busy September. We expanded our team by hiring two engineers, an engineering intern, and a lead generation expert. Since it takes time to onboard new team members, we didn't plan too much for September. Despite that, we successfully delivered two features that we had been planning for a long time. Additionally, we moved our blog posts to a new platform called Ghost, which has improved the writing experience. Previously, we used Sanity, but I may write another blog post explaining why we made the switch. All in all, it was a productive month for us.

Long story short, let's jump to our big updates.

Recording Of User Activity

Brokee is a platform that offers technical skills assessments to potential hiring candidates. The candidates are given access to live IT infrastructure and are required to fix a broken application to showcase their technical skills with specific technical stacks. Previously, we provided a text-based history of the candidate's user activity that showed which commands they used to troubleshoot and fix various problems with the application's configuration, environment, or security.

Terminal History

This approach was helpful in providing a quick glimpse of how the candidate was attempting to fix IT infrastructure issues. It allowed us to see where candidates got stuck for 5-20 minutes and needed to spend time reading documentation or searching for potential fixes on the internet. However, it lacked some depth as we couldn't see what was happening when the candidate was editing a file. This made it difficult to judge if specific changes were relevant or if the candidate was just looking at a file without making any changes. We do provide automated evaluations of each test to ensure that the application is fixed at the end of the test, but it's still important to know exactly how the problem was solved.

So, we've integrated asciinema into our testing environment. Now, you can replay the whole user activity with a click of a button.

Asciinema Player

While this is great, nobody wants to spend 30-60 minutes rewatching the terminal activity of every hiring candidate, so we suggest the following approach for technical team members to spend the least amount of time analyzing user activity:

• Take a 1-minute look at the history of user commands.

• If you see something interesting or unusual, look at the time stamp, and jump to the specific time in the recording to understand what was happening in detail.

This way, you can quickly understand how exactly candidates solved specific problems in a fast and efficient manner.

AI-Generated Summary of Candidate Performance

Another major update on Brokee was the integration of AI into automated evaluations of candidate performance. While the history of user commands and replaying of user activity can help technical team members understand how every candidate fixes problems, every engineer has different skill sets and experience levels. As a result, less technical members of the hiring team may not be able to understand user activity, making textual and video representations insufficient to make informed decisions about the best hire. To address this, we asked ourselves how we could make the results more accessible to everyone on the hiring team?

Meet AI summaries of candidate performance:

As we are gathering data on user activity, we can use it to generate a structured summary with easily understandable explanations of what occurred in the testing environment. This allows everyone to quickly review the report and have a common understanding of which tools the candidate used to troubleshoot problems, along with their general purpose (such as networking configuration, working with files, security configuration, etc.). Additionally, the report highlights any changes made to the environment, and provides details on specific configurations used. As there are multiple ways to fix the same problem, even experienced engineers can learn something new by reviewing the AI-generated summary, especially if the candidate used a new tool to resolve an issue.

This is great because our automated evaluations can serve as performance reports as well as educational materials for the entire team. If you have multiple candidates who have completed skills assessments, you can refer to this report to identify the most efficient and creative problem solvers for issues with IT infrastructure.

Reporting Recap

This is just the beginning. We plan to provide more advanced reports in the future, but just to recap, here's what Brokee offers right now in terms of reporting:

• Test Completion Status: Passed/Failed

• Time Taken To Complete Assessment

• Number of Completed Subtasks

• Automated Checks

• AI-Generated Summary of User Activity

• History of Commands

• Recording of Terminal Activity

We strive to be your top choice in hiring DevOps and Cloud engineers. If you're planning to hire or need help assessing candidates, please contact us via our website, and don't forget to follow us on Linkedin and Facebook.

We’re Offering Free Service to Ukrainian Companies!

Photo by Max Kukurudziak / Unsplash

Our Offer to Ukrainian Companies

We will provide free Brokee testing services on a first-come, first-served basis. The number of places is limited and will depend on the available funds and demand.

Our Mission:

As a leading tech hub in Europe, Ukraine boasts an impressive tech workforce of approximately 300,000 professionals. This thriving tech ecosystem is home to global companies like Grammarly, GitLab, and Wix, which were all founded in Ukraine.

The highly skilled tech professionals in Ukraine are making a significant impact on the global economy and technology landscape through the innovative solutions they create.

We at Brokee are proud to be a Ukrainian-built company, and much of what we do is inspired by our support for the Ukrainian tech sector. Recently, Brokee launched an initiative to offer our solution - which is an alternative to DevOps engineer assessments - for Ukrainian companies free of charge.

Who Qualifies for Free Brokee Testing Services?

- Ukrainian startups, especially those still in the very early stages of development and who have not received funding.

- Ukrainian IT companies or IT recruiting agencies affected by the war.

- IT schools with a social component - if you are teaching people for free or helping Ukraine in some other way, we are happy to help you.

- Large Ukrainian IT companies: Brokee’s services are affordable, so we do not expect that payment for our services will be a problem for large IT companies. However, we are happy to provide a free trial, especially for companies that donate to Ukraine’s defenders or other Ukrainian charities.

What is the Duration of This Offer?

We plan to provide free testing for qualified companies for approximately six months, or until Ukraine’s victory. On average, we help reduce DevOps hiring costs by over $3000 and several weeks per role.

Brokee is a startup currently without funding, and I personally have been using any profits and my own savings to keep it operating.

I believe in Brokee and what it can provide companies, so I developed this program to support Ukraine's tech sector. Our service has helped multiple companies streamline their DevOps hiring.

How to Get Started

Book a call with us using this link or fill out the contact form on the Brokee website. If you are a DevOps or Cloud Systems Engineer and would like to try out challenges - such as Amazon DevOps, GPT, Linux, Ingnx, and more - please indicate which test you are interested in and we will send you an invitation.

For anyone interested in collaborating or working with Brokee, don’t hesitate to reach out.

Slava Ukraini!

Photo by Yurii Khomitskyi / Unsplash