While I appreciate the contributions Databricks's makes to the open source community, *this video is incredibly misleading*. DBRX is *not* the highest production quality open-source model nor the best in price per performance. The graph you showed is incredibly misleading, not least because you compared your models to LLaMa2-70B. No one in their right mind at the time of this video's recording is using LLaMa2-70B. Everyone has moved on to LLaMa3, with many providers even disabling LLaMa2 on their platforms because it is more expensive and less performant than LLaMa3. A fairer comparison would be between DBRX and LLaMa3-70B and LLaMa3-8B. You didn’t show that because DBRX gets roasted in these comparisons. (Your talked about the cost associated with training your LLMs and how the cost has come down substantially. Really, this is an argument that the $10M Mosaic/Databricks have spent on DBRX is already redundant. You guys are losing credibility by posting stuff like this. Databricks does some great work. Don’t tarnish your reputation with borderline fraudulent content like this.
While I appreciate the contributions Databricks's makes to the open source community, *this video is incredibly misleading*.
DBRX is *not* the highest production quality open-source model nor the best in price per performance.
The graph you showed is incredibly misleading, not least because you compared your models to LLaMa2-70B.
No one in their right mind at the time of this video's recording is using LLaMa2-70B.
Everyone has moved on to LLaMa3, with many providers even disabling LLaMa2 on their platforms because it is more expensive and less performant than LLaMa3.
A fairer comparison would be between DBRX and LLaMa3-70B and LLaMa3-8B. You didn’t show that because DBRX gets roasted in these comparisons.
(Your talked about the cost associated with training your LLMs and how the cost has come down substantially.
Really, this is an argument that the $10M Mosaic/Databricks have spent on DBRX is already redundant.
You guys are losing credibility by posting stuff like this.
Databricks does some great work. Don’t tarnish your reputation with borderline fraudulent content like this.