From fd86e969537d19ecae21a22780504cb74a5a8296 Mon Sep 17 00:00:00 2001 From: Josh Dimarsky <24758845+yehoshuadimarsky@users.noreply.github.com> Date: Wed, 3 Jun 2020 18:40:48 +0000 Subject: [PATCH 1/2] added bcpandas to ecosystem --- doc/source/ecosystem.rst | 11 +++++++++++ 1 file changed, 11 insertions(+) diff --git a/doc/source/ecosystem.rst b/doc/source/ecosystem.rst index 62065f016e438..619e1265aac96 100644 --- a/doc/source/ecosystem.rst +++ b/doc/source/ecosystem.rst @@ -325,6 +325,17 @@ dimensional arrays, rather than the tabular data for which pandas excels. Out-of-core ------------- +`BCPandas `__ +~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ + +BCPandas provides high performance writes from pandas to Microsoft SQL Server, +far exceeding the performance of the native ``df.to_sql`` method. Internally, it uses +Microsoft's BCP utility, but the complexity is fully abstracted away from the end user. +Rigorously tested, it is a complete replacement for ``df.to_sql``. + +(Testing has shown that the same peformance speedup is not achieved when reading data, +only when writing data, so it is not a full I/O replacement, just the "I" part). + `Blaze `__ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ From f0f81f9eb921e904abb28a1c9fe522595c9b28ad Mon Sep 17 00:00:00 2001 From: Josh Dimarsky <24758845+yehoshuadimarsky@users.noreply.github.com> Date: Thu, 4 Jun 2020 15:28:30 +0000 Subject: [PATCH 2/2] made new section for "IO" --- doc/source/ecosystem.rst | 13 ++++++++----- 1 file changed, 8 insertions(+), 5 deletions(-) diff --git a/doc/source/ecosystem.rst b/doc/source/ecosystem.rst index 619e1265aac96..72e24e34bc5c1 100644 --- a/doc/source/ecosystem.rst +++ b/doc/source/ecosystem.rst @@ -320,10 +320,10 @@ provide a pandas-like and pandas-compatible toolkit for analytics on multi- dimensional arrays, rather than the tabular data for which pandas excels. -.. _ecosystem.out-of-core: +.. _ecosystem.io: -Out-of-core -------------- +IO +-- `BCPandas `__ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ @@ -333,8 +333,11 @@ far exceeding the performance of the native ``df.to_sql`` method. Internally, it Microsoft's BCP utility, but the complexity is fully abstracted away from the end user. Rigorously tested, it is a complete replacement for ``df.to_sql``. -(Testing has shown that the same peformance speedup is not achieved when reading data, -only when writing data, so it is not a full I/O replacement, just the "I" part). + +.. _ecosystem.out-of-core: + +Out-of-core +------------- `Blaze `__ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~