The Challenge Penn Foster Group Faced
Penn Foster Group, a leader in online education and workforce development, faced significant challenges with its legacy data systems, which were limiting its ability to deliver personalized learning experiences and scale its operations. The organization’s existing data warehouse, built on an aging SQL server-based architecture, was unable to keep up with the demands of modern AI and machine learning technologies. As a result, Penn Foster struggled to innovate and integrate advanced technologies like machine learning and streaming data to create personalized, outcome-based training programs.
Recognizing that a move to a more scalable, AI-ready data platform was essential for future growth, Penn Foster embarked on a project to migrate from its legacy Snowflake data warehouse to the Databricks Data Intelligence Platform. The migration required not only the selection of a robust data platform but also additional expertise and resources to support the transition.
Penn Foster turned to Koantek for assistance, as their internal data team lacked the bandwidth and experience to manage such a transformative project on their own.
How Koantek Responded
Koantek collaborated closely with Penn Foster to assess their specific needs and design a solution that would enable them to move forward with their personalized education initiative. Koantek proposed a strategic 4-week project to migrate Penn Foster’s data stack to the Databricks Data Intelligence Platform, providing the group with a unified data foundation to support future AI-driven innovations.
The migration process was carried out in phases, with Koantek not only ensuring a smooth transition of the data infrastructure but also empowering Penn Foster's team by providing the necessary training and resources to operate the new platform independently. Koantek’s expertise proved invaluable when Penn Foster expanded by acquiring healthcare training provider Carrus, requiring additional data integration into the new platform.
“Our relationship with Koantek has always been a partnership, not a dictatorship,” said Stephen Tiepel, Senior Director at Penn Foster Group.
“Together, we’ve migrated to a Databricks platform that powers our innovation. It has been a fantastic journey for us.”
The Results
With its new data infrastructure in place, Penn Foster was able to rapidly innovate and implement machine learning models to support its personalized learning initiatives. One of the first projects developed on the Databricks platform was Ultron, a machine learning model pipeline that scores incoming leads based on multiple machine learning models. This system, powered by MLflow on Azure Databricks, allows Penn Foster’s marketing team to receive lead scores in real-time and take immediate action, significantly improving conversion rates and efficiency.
Additionally, Penn Foster developed AI-driven solutions to enhance the student experience. One project, which uses AI to provide live feedback on student writing, has already reduced the need for students to re-submit assignments multiple times, improving their learning experience and reducing administrative workload. Another project leverages generative AI to accelerate content creation, significantly shortening the development timeline for new courses, from four months to a matter of weeks.
“The real-time data and AI capabilities we now have in place allow us to personalize education on a whole new level,” Tiepel explained. “We can deliver the right learning experience at the right time for each student, helping them progress at their own pace.”
Conclusion
By partnering with Koantek and leveraging the Databricks platform, Penn Foster was able to modernize its data infrastructure, integrate machine learning, and launch cutting-edge AI-driven solutions that enhance both the student experience and operational efficiency. The successful migration laid the foundation for Penn Foster’s long-term innovation goals, including AI-powered content creation, real-time student feedback, and personalized learning pathways.
As Penn Foster continues to expand its AI-driven educational offerings, Koantek remains a trusted partner in driving these initiatives forward. With the help of Databricks and Koantek, Penn Foster is poised to continue shaping the future of online education by providing customized learning experiences that prepare students for the careers of tomorrow.