Real-world test of the top three AI office solutions: Doubao is full-featured, WorkBuddy is highly stable, and Qianwen still needs to put in more efforts to improve.
Since September, office Agents have ushered in a new round of intensive updates.
Alibaba's Qwen Office, Tencent's WorkBuddy and ByteDance's Doubao Work have once again entered a head-to-head competition.
Doubao Work has the highest update frequency. On September 2, it launched the multi-Agents parallelism and computer operation function; a week later, it supplemented local Office editing, browser recording and playback, and free switching between local and cloud computers. On September 15, Doubao Work and Feishu jointly released Doubao Work Partner, allowing the Agent to join group chats and receive tasks assigned by different members.
The other two are also accelerating their iteration. On September 7, Qwen Office launched a multi-user workspace, where users can describe requirements in natural language to generate a web application that supports up to 100 people collaborating online at the same time. Previously, it announced that just one month after its launch, the number of users had exceeded 30 million. On September 2, the WorkBuddy Open Platform was officially launched, with more than 100 ecological partners gathered in the first batch, supporting access to more than a dozen categories of hardware such as smart glasses, voice recording cards, and smart headphones. Tencent also released 9 co-branded hardware products simultaneously.
This round of updates has a common direction: office Agents are stepping into more real work scenarios. Files in the computer, discussions in group chats, and information recorded by portable devices may all become clues for it to understand tasks.
When their functions become more and more similar, how should ordinary users choose?
We selected four types of jobs: marketing, content operation, product manager and development, set real work tasks respectively, and assigned them to Qwen Office, Doubao Work and WorkBuddy for completion, calling their latest flagship models. The performances of the three are as follows:
Doubao Work takes the lead overall, with strong multi-modal capabilities, and is suitable for people with high demand for creative presentation such as pictures and videos in work;
WorkBuddy has a user-friendly product design, which is especially suitable for people with light development needs;
Qwen Office is unremarkable and even can be described as mediocre, but it can complete basic office tasks.
Next, let's take a specific look at their performances.
01. Marketing: Qwen is cautious, WorkBuddy is meticulous, Doubao is efficient
Marketing is one of the professions where AI can be easily integrated into the workflow at present. Information collection, sorting and analysis, and draft of materials can all be handed over to the Agent for a preliminary run.
First, let the three Agents make a competitive product analysis. The most worrying part of this process is incomplete information and perfunctory analysis. The "style" of the three Agents can be felt from the moment they receive the task.
Qwen Office is like a meticulous secretary, who will confirm the delivery format and the selection of benchmark brands before starting work, and will not start until all details are clarified.
Qwen Office's thinking process
The web page it submitted has relatively limited information, listing the relevant situations of three competing products, but the content expanded in each dimension is relatively small, and the analysis of the overall industry is also insufficient.
Competitive product analysis made by Qwen Office
WorkBuddy shows you the whole process first. It first submits a research process document, explains why these three companies are selected as benchmark objects, and then carries out the analysis.
WorkBuddy's thinking process
The finished product also maintains this meticulous style. The report adds a directory, introduces the market situation first, and then shows the dynamics of competing products. It has the largest number of analysis dimensions, the most sufficient expansion of competing product information, and briefly summarizes the characteristics of each brand.
Competitive product analysis made by WorkBuddy
In the part of market opportunities, it lists 5 entry directions, and attaches the data source and caliber description at the end for easy verification.
Competitive product analysis made by WorkBuddy
After receiving the task, Doubao Work called the newly launched multi-Agents parallel function by itself, allowing several sub-Agents to conduct separate research and then complete the report.
Doubao Work's thinking process
Finally, it submitted two versions: a web version and a Feishu document version. The content is roughly the same. The web version uses more tables, and the primary and secondary information is clearer.
Competitive product analysis made by Doubao Work
In addition to introducing the three brands in points, its horizontal comparison of different competing products is more outstanding, using charts to compare the key data of each company.
Competitive product analysis made by Doubao Work
It also uses a timeline to string together the dynamics of the three companies, so that users can intuitively see the actions of each company.
Competitive product analysis made by Doubao Work
The competitive report is the "core content", and the marketing materials are the "external presentation". We provided a complete brief for a new bagel product, requiring the output of the main visual poster, Xiaohongshu cover image and a 15-second warm-up video.
To start with the conclusion, in this test, Doubao Work actively called the dedicated video generation model and text-to-image model, and its overall completion degree is the highest.
Especially for the video. Doubao Work designed a simple plot line to string together the production process of bagels, the shots are progressive, and background music and narration are also added, which is most like a complete new product preview.
The overall effect of the pictures is also qualified, but there is a part of text crowded together in the main visual. It can be used as a draft, and these details need to be processed before formal use.
Posters made by Doubao Work, left: main visual / right: Xiaohongshu cover
The two images generated by Qwen Office are relatively stiff, which looks like the most common templates in design software.
Posters made by Qwen Office, left: main visual / right: Xiaohongshu cover
But its shortcoming is mainly in the video. The video looks like making the main visual move and switching different perspectives to display the bread picture, and the whole is more like a dynamic poster.
WorkBuddy first makes the text-free poster move, then cuts to the close-up of breaking the bagel, and finally returns to the main visual with a jitter effect. Compared with the one made by Qwen Office, the quality is similar, and its advantage lies in the richer picture.
The poster it generated is quite conventional, with no particularly outstanding features.
Posters made by WorkBuddy, left: main visual / right: Xiaohongshu cover
What really widens the gap in this round is not the text, but the delivery form. All three Agents can do research, but once the task moves to links such as posters and short videos, the multi-modal generation advantage of Doubao Work becomes more obvious; if the main task stays at data collection and analysis, WorkBuddy is also a good choice.
02.
Content Operation: WorkBuddy submits quickly, Doubao splits tasks in detail
Half of the content operation work is to follow hot topics, and the other half is to conceive content topics.
We first asked the three to sort out the recent AI hot topics, and then give topic plans to see who can collect the most complete information and provide the best suggestions.
WorkBuddy responded the fastest and submitted the result in 11 minutes. Its hot topics are sorted out by categories such as models, capital, and policies, which basically cover the important dynamics of the past week, and it is convenient for users to quickly catch up with the latest progress.
Hot topic summary made by WorkBuddy
Unfortunately, the 5 topics given are a bit too general and not very operable.
Topic planning made by WorkBuddy
Qwen Office directly gave the answer in the dialog box, without generating additional documents or web pages. The content is also relatively short, the hot topics are divided into three aspects, and the amount of information is small.
Hot topic summary made by Qwen Office
The topic is only briefly mentioned, and the reference value it can provide is limited.