Devin.ai

2025-05

2025-02

2025-01

Devin自身に作業ログや日誌を書かせている

Devinをチームで導入し、1ヶ月で20件ほどのタスクを依頼してみての振り返り

小規模で明確なタスク（例: API統合や簡単なスクリプト作成）では高い成功率を示した。自律的にコードを生成し、タスクを進める能力がある。最初はエキサイティングだった

複雑なタスクやリサーチでは、非効率的な解決策や進捗の停滞が多い。自律性が裏目に出て、不可能なタスクにも時間を浪費する傾向がある

Tasks it can do are those that are so small and well-defined that I may as well do them myself, faster, my way. Larger tasks where I might see time savings I think it will likely fail at. So no real niche where I’ll want to use it. - Johno Whitaker

I had initial excitement at how close it was because I felt I could tweak a few things. And then slowly got frustrated as I had to change more and more to end up at the point where I would have been better of starting from scratch and going step by step. - Isaac Flath

Devin struggled to use internal tooling that is critical at AnswerAI which, in addition to other issues, made it difficult to use. This is despite providing Devin with copious amounts of documentation and examples. I haven’t found this to be an issue with tools like Cursor, where there is more opportunity to nudge things in the right direction more incrementally. - Hamel Husain

学び

小さなタスクは人間が直接行った方が効率的。大規模なタスクではAIの限界が顕著

AIツールは「自律性」よりも、人間主導で支援を受ける形態（例: Cursor）の方が実用的である