AppPkg/Applications/Python/Python-2.7.10/Py2710ReadMe.txt - edk2 - Git at Google

                                 EDK II Python
                                    ReadMe
                                 Version 2.7.10
                                  Release 1.00
                                   3 Nov. 2015


 1. OVERVIEW
 ===========
 This document is devoted to general information on building and setup of the
 Python environment for UEFI, the invocation of the interpreter, and things
 that make working with Python easier.

 It is assumed that you already have UDK2010 or later, or a current snapshot of
 the EDK II sources from www.tianocore.org, and that you can successfully build
 packages within that distribution.

 2. Release Notes
 ================
   1)  All C extension modules must be statically linked (built in)
   2)  The site and os modules must exist as discrete files in ...\lib\python27.10
   3)  User-specific configurations are not supported.
   4)  Environment variables are not supported.

 3. Getting and Building Python
 ======================================================
   3.1 Getting Python
   ==================
   This file describes the UEFI port of version 2.7.10 of the CPython distribution.
   For development ease, a subset of the Python 2.7.10 distribution has been
   included as part of the AppPkg/Applications/Python/Python-2.7.10 source tree.
   If this is sufficient, you may skip to section 3.2, Building Python.

   If a full distribution is desired, it can be merged into the Python-2.7.10
   source tree.  Directory AppPkg/Applications/Python/Python-2.7.10 corresponds
   to the root directory of the CPython 2.7.10 distribution.  The full
   CPython 2.7.10 source code may be downloaded from
   http://www.python.org/ftp/python/2.7.10/.

   A.  Within your EDK II development tree, extract the Python distribution into
     AppPkg/Applications/Python/Python-2.7.10.  This should merge the additional
     files into the source tree.  It will also create the following directories:
         Demo      Doc         Grammar     Mac       Misc
         PC        PCbuild     RISCOS      Tools

     The greatest change will be within the Python-2.7.10/Lib directory where
     many more packages and modules will be added.  These additional components
     may not have been ported to EDK II yet.

   3.2 Building Python
   ===================
   A.  From the AppPkg/Applications/Python/Python-2.7.10 directory, execute the
     srcprep.bat (srcprep.sh) script to copy the header files from within the
     PyMod-2.7.10 sub-tree into their corresponding directories within the
     distribution.  This step only needs to be performed prior to the first
     build of Python, or if one of the header files within the PyMod tree has been
     modified.

   B.  Edit PyMod-2.7.10\Modules\config.c to enable the built-in modules you need.
     By default, it is configured for the minimally required set of modules.
       Mandatory Built-in Modules:
         edk2      errno       imp         marshal

       Additional built-in modules which are required to use the help()
       functionality provided by PyDoc, are:
         _codecs     _collections    _functools    _random
         _sre        _struct         _weakref      binascii
         cStringIO   gc              itertools     math
         operator    time

   C.  Edit AppPkg/AppPkg.dsc to enable (uncomment) the Python2710.inf line
     within the [Components] section.

   D.  Build AppPkg using the standard "build" command:
     For example, to build Python for an X64 CPU architecture:
                     build -a X64 -p AppPkg\AppPkg.dsc

 4. Python-related paths and files
 =================================
 Python depends upon the existence of several directories and files on the
 target system.

   \EFI                              Root of the UEFI system area.
    |- \Tools                        Location of the Python.efi executable.
    |- \Boot                         UEFI specified Boot directory.
    |- \StdLib                       Root of the Standard Libraries sub-tree.
        |- \etc                      Configuration files used by libraries.
        |- \tmp                      Temporary files created by tmpfile(), etc.
        |- \lib                      Root of the libraries tree.
            |- \python27.10          Directory containing the Python library
                |                    modules.
                |- \lib-dynload      Dynamically loadable Python extensions.
                |- \site-packages    Site-specific packages and modules.

   NOTE: The name of the directory containing the Python library modules has
         changed in order to distinguish it from the library modules for
         version 2.7.2.

 5. Installing Python
 ====================
 These directories, on the target system, are populated from the development
 system as follows:

   * \Efi\Tools receives a copy of Build/AppPkg/DEBUG_VS2015/X64/Python2710.efi.
                                                ^^^^^^^^^^^^^^^^
     Modify the host path to match your build type and compiler.

   * The \Efi\StdLib\etc directory is populated from the StdLib/Efi/StdLib/etc
     source directory.

   * Directory \Efi\StdLib\lib\python27.10 is populated with packages and modules
     from the AppPkg/Applications/Python/Python-2.7.10/Lib directory.
     The recommended minimum set of modules (.py, .pyc, and/or .pyo):
         os      stat      ntpath      warnings      traceback
         site    types     copy_reg    linecache     genericpath

   * Python C Extension Modules built as dynamically loadable extensions go into
     the \Efi\StdLib\lib\python.27\lib-dynload directory.  This functionality is not
     yet implemented.

   A script, libprep.bat (libprep.sh), is provided which facilitates the population
   of the target Lib directory.  Execute this script from within the
   AppPkg/Applications/Python/Python-2.7.10 directory, providing a single argument
   which is the path to the destination directory.  The appropriate contents of the
   AppPkg/Applications/Python/Python-2.7.10/Lib and
   AppPkg/Applications/Python/Python-2.7.10/PyMod-2.7.10/Lib directories will be
   recursively copied into the specified destination directory.

 6. Example: Enabling socket support
 ===================================
   1.  enable {"_socket", init_socket}, in Efi\config.c
   2.  enable LibraryClasses BsdSocketLib and EfiSocketLib in PythonCore.inf.
   3.  Build Python2710
           build -a X64 -p AppPkg\AppPkg.dsc
   6.  copy Build\AppPkg\DEBUG_VS2005\X64\Python2710.efi to \Efi\Tools on your
       target system. Replace "DEBUG_VS2005\X64", in the source path, with
       values appropriate for your tool chain and processor architecture.

 7. Running Python
 =================
   Python must currently be run from an EFI FAT-32 partition, or volume, under
   the UEFI Shell.  At the Shell prompt enter the desired volume name, followed
   by a colon ':', then press Enter.  Python can then be executed by typing its
   name, followed by any desired options and arguments.

   EXAMPLE:
       2.0 Shell> fs0:
       2.0 FS0:\> python2710
       Python 2.7.10 (default, Oct 13 2015, 16:21:53) [C] on uefi
       Type "help", "copyright", "credits" or "license" for more information.
       >>> exit()
       2.0 FS0:\>

   NOTE:
       Python, as distributed, sends its interactive prompts to stderr.  If
       STDERR isn't enabled in UEFI Setup so that it's output goes to the
       console, it may appear that Python hangs on startup.  If this happens,
       one may be able to rectify the condition by typing "exit()" followed
       by <enter> to exit out of Python.  Then, type "exit" at the Shell prompt
       which should enter Setup where you can use the Boot Maintenance
       Manager to modify your Console settings.

   NOTE:
       Some platforms don't include the Setup utility, or don't allow STDERR to
       be modified.  In these cases, Python may be started with the '-#' option
       which will cause stderr to be the same as stdout and should allow
       Python to be used interactively on those platforms.

       Depending upon the version of Shell you are using, it may be necessary
       to escape the '#' character so that the Shell doesn't interpret it as
       the start of a comment.  The escape character is '^'.
       Example:
           python -^# -V

 8. Supported C Modules
 ======================
     Module Name               C File(s)
   ===============       =============================================
   _ast                  Python/Python-ast.c
   _bisect               Modules/_bisectmodule.c
   _codecs               Modules/_codecsmodule.c
   _codecs_cn            Modules/cjkcodecs/_codecs_cn.c
   _codecs_hk            Modules/cjkcodecs/_codecs_hk.c
   _codecs_iso2022       Modules/cjkcodecs/_codecs_iso2022.c
   _codecs_jp            Modules/cjkcodecs/_codecs_jp
   _codecs_kr            Modules/cjkcodecs/_codecs_kr
   _codecs_tw            Modules/cjkcodecs/_codecs_tw
   _collections          Modules/_collectionsmodule.c
   _csv                  Modules/_csv.c
   _functools            Modules/_functoolsmodule.c
   _heapq                Modules/_heapqmodule.c
   _io                   Modules/_io/_iomodule.c       Modules/_io/*
   _json                 Modules/_json.c
   _md5                  Modules/md5module.c           Modules/md5.c
   _multibytecodec       Modules/cjkcodecs/_multibytecodec.c
   _random               Modules/_randommodule.c
   _sha                  Modules/shamodule.c
   _sha256               Modules/sha256module.c
   _sha512               Modules/sha512module.c
   _socket               Modules/socketmodule.c
   _sre                  Modules/_sre.c
   _struct               Modules/_struct.c
   _symtable             Modules/symtablemodule.c
   _weakref              Modules/_weakref.c
   array                 Modules/arraymodule.c
   binascii              Modules/binascii.c
   cmath                 Modules/cmathmodule.c
   cPickle               Modules/cPickle.c
   cStringIO             Modules/cStringIO.c
   datetime              Modules/datetimemodule.c
   edk2                  Modules/Efi/edk2module.c
   errno                 Modules/errnomodule.c
   future_builtins       Modules/future_builtins.c
   gc                    Modules/gcmodule.c
   imp                   Python/import.c
   itertools             Modules/itertoolsmodule.c
   marshal               Python/marshal.c
   math                  Modules/mathmodule.c          Modules/_math.c
   operator              Modules/operator.c
   parser                Modules/parsermodule.c
   select                Modules/selectmodule.c
   signal                Modules/signalmodule.c
   strop                 Modules/stropmodule.c
   time                  Modules/timemodule.c
   xxsubtype             Modules/xxsubtype.c
   zipimport             Modules/zipimport.c
   zlib                  Modules/zlibmodule.c          Modules/zlib/*


 9. Tested Python Library Modules
 ================================
 This is a partial list of the packages and modules of the Python Standard
 Library that have been tested or used in some manner.

   encodings               genericpath.py            sha.py
   importlib               getopt.py                 SimpleHTTPServer.py
   json                    hashlib.py                site.py
   pydoc_data              heapq.py                  socket.py
   xml                     HTMLParser.py             SocketServer.py
   abc.py                  inspect.py                sre.py
   argparse.py             io.py                     sre_compile.py
   ast.py                  keyword.py                sre_constants.py
   atexit.py               linecache.py              sre_parse.py
   BaseHTTPServer.py       locale.py                 stat.py
   binhex.py               md5.py                    string.py
   bisect.py               modulefinder.py           StringIO.py
   calendar.py             ntpath.py                 struct.py
   cmd.py                  numbers.py                textwrap.py
   codecs.py               optparse.py               token.py
   collections.py          os.py                     tokenize.py
   copy.py                 platform.py               traceback.py
   copy_reg.py             posixpath.py              types.py
   csv.py                  pydoc.py                  warnings.py
   dummy_thread.py         random.py                 weakref.py
   fileinput.py            re.py                     xmllib.py
   formatter.py            repr.py                   zipfile.py
   functools.py            runpy.py                  expat

 # # #
	EDK II Python
	ReadMe
	Version 2.7.10
	Release 1.00
	3 Nov. 2015


	1. OVERVIEW
	===========
	This document is devoted to general information on building and setup of the
	Python environment for UEFI, the invocation of the interpreter, and things
	that make working with Python easier.

	It is assumed that you already have UDK2010 or later, or a current snapshot of
	the EDK II sources from www.tianocore.org, and that you can successfully build
	packages within that distribution.

	2. Release Notes
	================
	1) All C extension modules must be statically linked (built in)
	2) The site and os modules must exist as discrete files in ...\lib\python27.10
	3) User-specific configurations are not supported.
	4) Environment variables are not supported.

	3. Getting and Building Python
	======================================================
	3.1 Getting Python
	==================
	This file describes the UEFI port of version 2.7.10 of the CPython distribution.
	For development ease, a subset of the Python 2.7.10 distribution has been
	included as part of the AppPkg/Applications/Python/Python-2.7.10 source tree.
	If this is sufficient, you may skip to section 3.2, Building Python.

	If a full distribution is desired, it can be merged into the Python-2.7.10
	source tree. Directory AppPkg/Applications/Python/Python-2.7.10 corresponds
	to the root directory of the CPython 2.7.10 distribution. The full
	CPython 2.7.10 source code may be downloaded from
	http://www.python.org/ftp/python/2.7.10/.

	A. Within your EDK II development tree, extract the Python distribution into
	AppPkg/Applications/Python/Python-2.7.10. This should merge the additional
	files into the source tree. It will also create the following directories:
	Demo Doc Grammar Mac Misc
	PC PCbuild RISCOS Tools

	The greatest change will be within the Python-2.7.10/Lib directory where
	many more packages and modules will be added. These additional components
	may not have been ported to EDK II yet.

	3.2 Building Python
	===================
	A. From the AppPkg/Applications/Python/Python-2.7.10 directory, execute the
	srcprep.bat (srcprep.sh) script to copy the header files from within the
	PyMod-2.7.10 sub-tree into their corresponding directories within the
	distribution. This step only needs to be performed prior to the first
	build of Python, or if one of the header files within the PyMod tree has been
	modified.

	B. Edit PyMod-2.7.10\Modules\config.c to enable the built-in modules you need.
	By default, it is configured for the minimally required set of modules.
	Mandatory Built-in Modules:
	edk2 errno imp marshal

	Additional built-in modules which are required to use the help()
	functionality provided by PyDoc, are:
	_codecs _collections _functools _random
	_sre _struct _weakref binascii
	cStringIO gc itertools math
	operator time

	C. Edit AppPkg/AppPkg.dsc to enable (uncomment) the Python2710.inf line
	within the [Components] section.

	D. Build AppPkg using the standard "build" command:
	For example, to build Python for an X64 CPU architecture:
	build -a X64 -p AppPkg\AppPkg.dsc

	4. Python-related paths and files
	=================================
	Python depends upon the existence of several directories and files on the
	target system.

	\EFI Root of the UEFI system area.
	\|- \Tools Location of the Python.efi executable.
	\|- \Boot UEFI specified Boot directory.
	\|- \StdLib Root of the Standard Libraries sub-tree.
	\|- \etc Configuration files used by libraries.
	\|- \tmp Temporary files created by tmpfile(), etc.
	\|- \lib Root of the libraries tree.
	\|- \python27.10 Directory containing the Python library
	\| modules.
	\|- \lib-dynload Dynamically loadable Python extensions.
	\|- \site-packages Site-specific packages and modules.

	NOTE: The name of the directory containing the Python library modules has
	changed in order to distinguish it from the library modules for
	version 2.7.2.

	5. Installing Python
	====================
	These directories, on the target system, are populated from the development
	system as follows:

	* \Efi\Tools receives a copy of Build/AppPkg/DEBUG_VS2015/X64/Python2710.efi.
	^^^^^^^^^^^^^^^^
	Modify the host path to match your build type and compiler.

	* The \Efi\StdLib\etc directory is populated from the StdLib/Efi/StdLib/etc
	source directory.

	* Directory \Efi\StdLib\lib\python27.10 is populated with packages and modules
	from the AppPkg/Applications/Python/Python-2.7.10/Lib directory.
	The recommended minimum set of modules (.py, .pyc, and/or .pyo):
	os stat ntpath warnings traceback
	site types copy_reg linecache genericpath

	* Python C Extension Modules built as dynamically loadable extensions go into
	the \Efi\StdLib\lib\python.27\lib-dynload directory. This functionality is not
	yet implemented.

	A script, libprep.bat (libprep.sh), is provided which facilitates the population
	of the target Lib directory. Execute this script from within the
	AppPkg/Applications/Python/Python-2.7.10 directory, providing a single argument
	which is the path to the destination directory. The appropriate contents of the
	AppPkg/Applications/Python/Python-2.7.10/Lib and
	AppPkg/Applications/Python/Python-2.7.10/PyMod-2.7.10/Lib directories will be
	recursively copied into the specified destination directory.

	6. Example: Enabling socket support
	===================================
	1. enable {"_socket", init_socket}, in Efi\config.c
	2. enable LibraryClasses BsdSocketLib and EfiSocketLib in PythonCore.inf.
	3. Build Python2710
	build -a X64 -p AppPkg\AppPkg.dsc
	6. copy Build\AppPkg\DEBUG_VS2005\X64\Python2710.efi to \Efi\Tools on your
	target system. Replace "DEBUG_VS2005\X64", in the source path, with
	values appropriate for your tool chain and processor architecture.

	7. Running Python
	=================
	Python must currently be run from an EFI FAT-32 partition, or volume, under
	the UEFI Shell. At the Shell prompt enter the desired volume name, followed
	by a colon ':', then press Enter. Python can then be executed by typing its
	name, followed by any desired options and arguments.

	EXAMPLE:
	2.0 Shell> fs0:
	2.0 FS0:\> python2710
	Python 2.7.10 (default, Oct 13 2015, 16:21:53) [C] on uefi
	Type "help", "copyright", "credits" or "license" for more information.
	>>> exit()
	2.0 FS0:\>

	NOTE:
	Python, as distributed, sends its interactive prompts to stderr. If
	STDERR isn't enabled in UEFI Setup so that it's output goes to the
	console, it may appear that Python hangs on startup. If this happens,
	one may be able to rectify the condition by typing "exit()" followed
	by <enter> to exit out of Python. Then, type "exit" at the Shell prompt
	which should enter Setup where you can use the Boot Maintenance
	Manager to modify your Console settings.

	NOTE:
	Some platforms don't include the Setup utility, or don't allow STDERR to
	be modified. In these cases, Python may be started with the '-#' option
	which will cause stderr to be the same as stdout and should allow
	Python to be used interactively on those platforms.

	Depending upon the version of Shell you are using, it may be necessary
	to escape the '#' character so that the Shell doesn't interpret it as
	the start of a comment. The escape character is '^'.
	Example:
	python -^# -V

	8. Supported C Modules
	======================
	Module Name C File(s)
	=============== =============================================
	_ast Python/Python-ast.c
	_bisect Modules/_bisectmodule.c
	_codecs Modules/_codecsmodule.c
	_codecs_cn Modules/cjkcodecs/_codecs_cn.c
	_codecs_hk Modules/cjkcodecs/_codecs_hk.c
	_codecs_iso2022 Modules/cjkcodecs/_codecs_iso2022.c
	_codecs_jp Modules/cjkcodecs/_codecs_jp
	_codecs_kr Modules/cjkcodecs/_codecs_kr
	_codecs_tw Modules/cjkcodecs/_codecs_tw
	_collections Modules/_collectionsmodule.c
	_csv Modules/_csv.c
	_functools Modules/_functoolsmodule.c
	_heapq Modules/_heapqmodule.c
	_io Modules/_io/_iomodule.c Modules/_io/*
	_json Modules/_json.c
	_md5 Modules/md5module.c Modules/md5.c
	_multibytecodec Modules/cjkcodecs/_multibytecodec.c
	_random Modules/_randommodule.c
	_sha Modules/shamodule.c
	_sha256 Modules/sha256module.c
	_sha512 Modules/sha512module.c
	_socket Modules/socketmodule.c
	_sre Modules/_sre.c
	_struct Modules/_struct.c
	_symtable Modules/symtablemodule.c
	_weakref Modules/_weakref.c
	array Modules/arraymodule.c
	binascii Modules/binascii.c
	cmath Modules/cmathmodule.c
	cPickle Modules/cPickle.c
	cStringIO Modules/cStringIO.c
	datetime Modules/datetimemodule.c
	edk2 Modules/Efi/edk2module.c
	errno Modules/errnomodule.c
	future_builtins Modules/future_builtins.c
	gc Modules/gcmodule.c
	imp Python/import.c
	itertools Modules/itertoolsmodule.c
	marshal Python/marshal.c
	math Modules/mathmodule.c Modules/_math.c
	operator Modules/operator.c
	parser Modules/parsermodule.c
	select Modules/selectmodule.c
	signal Modules/signalmodule.c
	strop Modules/stropmodule.c
	time Modules/timemodule.c
	xxsubtype Modules/xxsubtype.c
	zipimport Modules/zipimport.c
	zlib Modules/zlibmodule.c Modules/zlib/*


	9. Tested Python Library Modules
	================================
	This is a partial list of the packages and modules of the Python Standard
	Library that have been tested or used in some manner.

	encodings genericpath.py sha.py
	importlib getopt.py SimpleHTTPServer.py
	json hashlib.py site.py
	pydoc_data heapq.py socket.py
	xml HTMLParser.py SocketServer.py
	abc.py inspect.py sre.py
	argparse.py io.py sre_compile.py
	ast.py keyword.py sre_constants.py
	atexit.py linecache.py sre_parse.py
	BaseHTTPServer.py locale.py stat.py
	binhex.py md5.py string.py
	bisect.py modulefinder.py StringIO.py
	calendar.py ntpath.py struct.py
	cmd.py numbers.py textwrap.py
	codecs.py optparse.py token.py
	collections.py os.py tokenize.py
	copy.py platform.py traceback.py
	copy_reg.py posixpath.py types.py
	csv.py pydoc.py warnings.py
	dummy_thread.py random.py weakref.py
	fileinput.py re.py xmllib.py
	formatter.py repr.py zipfile.py
	functools.py runpy.py expat

	# # #