Jupyter Notebook Itemize

The Jupyter Notebook is an open-source web application that allows you to create and share documents that contain live code, equations, visualizations and narrative text. Uses include: data cleaning and transformation, numerical simulation, statistical modeling, data visualization, machine learning, and much more. According to Jupyter.org, “ The Jupyter Notebook is an open-source web application that allows you to create and share documents that contain live code, equations, visualizations, and the narrative text”. Markdown is a popular markup language used as a standard for data scientists and analysts. Jupyter Notebook - Markdown Cells - Markdown cell displays text which can be formatted using markdown language. In order to enter a text which should not be treated as code by Notebook server, it. The nature of a jupyter notebook (it’s a fancy text file) means that students necessarily must download their own version of it and edit it as they go. This encourages them to personalize the material and take ownership of it. They can even modify the examples in the text instantly see how it changes the outcome. Daft Punk - Technologic. The result is that an itemized list of contributions, like the one we have, cannot be used to calculate a grand total. That’s true in California and virtually anywhere else you work with campaign data. Overlooking that limitation is a rookie mistake routinely made by analysts new to this field. But that doesn’t mean our data is worthless.

The Jupyter Notebook is an interactive computing environment that enables users to author notebook documents that include:

  • Live code

  • Interactive widgets

  • Plots

  • Narrative text

  • Equations

  • Images

  • Video

These documents provide a complete and self-contained record of a computation that can be converted to various formats and shared with others using email, Dropbox, version control systems (like git/GitHub) or nbviewer.ipython.org.

Additional resources

This material is adapted from the ICESat2 Hackweek intro-jupyter-git session by @fperez.

Components¶

The Jupyter Notebook combines three components:

  • The notebook web application

  • Kernels

  • Notebook documents

Notebook web application¶

The notebook web application enables users to:

  • Edit code in the browser, with automatic syntax highlighting, indentation, and tab completion/introspection.

  • Run code from the browser, with the results of computations attached to the code which generated them.

  • See the results of computations with rich media representations, such as HTML, LaTeX, PNG, SVG, PDF, etc.

  • Create and use interactive JavaScript wigets, which bind interactive user interface controls and visualizations to reactive kernel side computations.

  • Author narrative text using the Markdown markup language.

  • Build hierarchical documents that are organized into sections with different levels of headings.

  • Include mathematical equations using LaTeX syntax in Markdown, which are rendered in-browser by MathJax.

Kernels¶

Simply put, the kernel is the engine that runs the code. Each kernel is capable of running code in a single programming language and there are kernels available in over 100 programming languages.

IPython is the default kernel, it runs Python code.

Notebook documents¶

Notebook documents contain the inputs and outputs of an interactive session as well as narrative text that accompanies the code but is not meant for execution. Rich output generated by running code, including HTML, images, video, and plots, is embeddeed in the notebook, which makes it a complete and self-contained record of a computation.

When you run the notebook web application on your computer, notebook documents are just files on your local filesystem with a .ipynb extension. This allows you to use familiar workflows for organizing your notebooks into folders and sharing them with others using email, Dropbox and version control systems.

Notebooks consist of a linear sequence of cells. There are three basic cell types:

  • Code cells: Input and output of live code that is run in the kernel

  • Markdown cells: Narrative text with embedded LaTeX equations

  • Raw cells: Unformatted text that is included, without modification, when notebooks are converted to different formats using nbconvert

Notebooks can be exported to different static formats including HTML, reStructeredText, LaTeX, PDF, and slide shows using Jupyter’s nbconvert utility.

Furthermore, any notebook document available from a public URL on or GitHub can be shared via http://nbviewer.jupyter.org. This service loads the notebook document from the URL and renders it as a static web page. The resulting web page may thus be shared with others without their needing to install Jupyter.

Body¶

The body of a notebook is composed of cells. Each cell contains either markdown, code input, code output, or raw text. Cells can be included in any order and edited at-will, allowing for a large ammount of flexibility for constructing a narrative.

  • Markdown cells - These are used to build a nicely formatted narrative around the code in the document. The majority of this lesson is composed of markdown cells.

  • Code cells - These are used to define the computational code in the document. They come in two forms: the input cell where the user types the code to be executed, and the output cell which is the representation of the executed code. Depending on the code, this representation may be a simple scalar value, or something more complex like a plot or an interactive widget.

  • Raw cells - These are used when text needs to be included in raw form, without execution or transformation.

Modality¶

The notebook user interface is modal. This means that the keyboard behaves differently depending upon the current mode of the notebook. A notebook has two modes: edit and command.

Edit mode is indicated by a blue cell border and a prompt showing in the editor area. When a cell is in edit mode, you can type into the cell, like a normal text editor.

Command mode is indicated by a grey cell background. When in command mode, the structure of the notebook can be modified as a whole, but the text in individual cells cannot be changed. Most importantly, the keyboard is mapped to a set of shortcuts for efficiently performing notebook and cell actions. For example, pressing c when in command mode, will copy the current cell; no modifier is needed.

Enter edit mode by pressing Enter or using the mouse to click on a cell’s editor area.

Enter command mode by pressing Esc or using the mouse to click outside a cell’s editor area.

Do not attempt to type into a cell when in command mode; unexpected things will happen!

Jupyter Notebook Itemized List

Mouse navigation¶

The first concept to understand in mouse-based navigation is that cells can be selected by clicking on them. The currently selected cell is indicated with a blue outline or gray background depending on whether the notebook is in edit or command mode. Clicking inside a cell’s editor area will enter edit mode. Clicking on the prompt or the output area of a cell will enter command mode.

The second concept to understand in mouse-based navigation is that cell actions usually apply to the currently selected cell. For example, to run the code in a cell, select it and then click the button in the toolbar or the Run->RunSelectedCells menu item. Similarly, to copy a cell, select it and then click the button in the toolbar or the Edit->Copy menu item. With this simple pattern, it should be possible to perform nearly every action with the mouse.

Markdown cells have one other state which can be modified with the mouse. These cells can either be rendered or unrendered. When they are rendered, a nice formatted representation of the cell’s contents will be presented. When they are unrendered, the raw text source of the cell will be presented. To render the selected cell with the mouse, click the button in the toolbar or the Run->RunSelectedCells menu item. To unrender the selected cell, double click on the cell.

Keyboard Navigation¶

The modal user interface of the Jupyter Notebook has been optimized for efficient keyboard usage. This is made possible by having two different sets of keyboard shortcuts: one set that is active in edit mode and another in command mode.

The most important keyboard shortcuts are Enter, which enters edit mode, and Esc, which enters command mode.

In edit mode, most of the keyboard is dedicated to typing into the cell’s editor. Thus, in edit mode there are relatively few shortcuts. In command mode, the entire keyboard is available for shortcuts, so there are many more possibilities.

The following shortcuts have been found to be the most useful in day-to-day tasks:

  • Basic navigation:

  • enter: Enter edit mode

  • shift-enter: run cell

  • up/k, down/j: Move to cell above/below

  • Saving the notebook: s

  • Cell types:

  • y: code

  • m: markdown

  • r: raw

  • Cell creation:

  • a: create new cell above current cell

  • b: create new cell below current cell

  • Cell editing:

  • x: cut

  • c: copy

  • v: paste

  • d: delete (press twice)

  • z: redo

  • Kernel operations (press twice):

  • i: interrupt kernel

  • 0: restart kernel

You can fully customize JupyterLab’s keybindings by accessing the Settings->AdvancedSettingsEditor menu item.

Running Code¶

Jupyter Notebook Itemize

First and foremost, the Jupyter Notebook is an interactive environment for writing and running code. Jupyter is capable of running code in a wide range of languages. However, this notebook, and the default kernel in Jupyter, runs Python code.

Code cells allow you to enter and run Python code¶

Run a code cell using Shift-Enter or pressing the button in the toolbar above:

Note the difference between the above printing statement and the operation below:

When a value is returned by a computation, it is displayed with a number, that tells you this is the output value of a given cell. You can later refere to any of these values (should you need one that you forgot to assign to a named variable). The last three are available respectively as auto-generated variables called _, __ and ___ (one, two and three underscores). In addition to these three convenience ones for recent results, you can use _N, where N is the number in [N], to access any numbered output.

There are two other keyboard shortcuts for running code:

  • Alt-Enter runs the current cell and inserts a new one below.

  • Note that Alt refers to the Option key on Macs. Make sure your browser settings do not intefere with the use of the Option key when using this shortcut.

  • Ctrl-Enter run the current cell and enters command mode.

  • Notice Shift-Enter runs the current cell and selects the cell below, while Ctrl-Enter stays on the executed cell in command mode.

Managing the IPython Kernel¶

Code is run in a separate process called the IPython Kernel. The Kernel can be interrupted or restarted. Try running the following cell and then hit the button in the toolbar above.

If the Kernel dies you will be prompted to restart it. Here we call the low-level system libc.time routine with the wrong argument viactypes to segfault the Python interpreter. To test it out, uncomment the next cell.

Run menu¶

The “Run” menu has a number of items for running code in different ways, including

  • Run Selected Cells

  • Run All Cells

  • Run Selected Cell or Current Line in Console

  • Run All Above Selected Cell

  • Run Selected Cell and All Below

  • Restart Kernel and Run All Cells

Restarting the kernels¶

The kernel maintains the state of a notebook’s computations. You can reset this state by restarting the kernel. This is done by clicking on the in the toolbar above.

sys.stdout and sys.stderr¶

The stdout (standard output) and stderr (standard error) streams are displayed as text in the output area.

Output is asynchronous¶

All output is displayed as it is generated in the Kernel: instead of blocking on the execution of the entire cell, output is made available to the Notebook immediately as it is generated by the kernel (even though the whole cell is submitted for execution as a single unit).

If you execute the next cell, you will see the output one piece at a time, not all at the end:

Large outputs¶

To better handle large outputs, the output area can be collapsed. Run the following cell and then click on the vertical blue bar to the left of the output:

Markdown Cells¶

Text can be added to IPython Notebooks using Markdown cells. Markdown is a popular markup language that is a superset of HTML. Its specification can be found here:

You can view the source of a cell by double clicking on it, or while the cell is selected in command mode, press Enter to edit it. One A cell has been editted, use Shift-Enter to re-render it.

Local files¶

If you have local files in your Notebook directory, you can refer to these files in Markdown cells directly:

For example, in the images folder, we have the Python logo:

and a video with the HTML5 video tag:

These do not embed the data into the notebook file, and require that the files exist when you are viewing the notebook.

Security of local files¶

Note that this means that the IPython notebook server also acts as a generic file serverfor files inside the same tree as your notebooks. Access is not granted outside thenotebook folder so you have strict control over what files are visible, but for thisreason it is highly recommended that you do not run the notebook server with a notebookdirectory at a high level in your filesystem (e.g. your home directory).

When you run the notebook in a password-protected manner, local file access is restrictedto authenticated users unless read-only views are active.

Extra Content¶

The following overview of Markdown is beyond the scope of this short tutorial, but it is included for your reference as you build your own Jupyter Notebooks during the Hackweek and beyond.

Markdown basics¶

You can make text italic or bold.

You can build nested itemized or enumerated lists:

  • One

    • Sublist

      • This

    • Sublist- That- The other thing

  • Two

    • Sublist

  • Three

    • Sublist

Jupiter Notebook Itemized

Now another list:

  1. Here we go

    1. Sublist

    2. Sublist

  2. There we go

  3. Now this

You can add horizontal rules: ---

Here is a blockquote:

Jupyter Notebook Latex Itemize

Beautiful is better than ugly.Explicit is better than implicit.Simple is better than complex.Complex is better than complicated.Flat is better than nested.Sparse is better than dense.Readability counts.Special cases aren’t special enough to break the rules.Although practicality beats purity.Errors should never pass silently.Unless explicitly silenced.In the face of ambiguity, refuse the temptation to guess.There should be one– and preferably only one –obvious way to do it.Although that way may not be obvious at first unless you’re Dutch.Now is better than never.Although never is often better than right now.If the implementation is hard to explain, it’s a bad idea.If the implementation is easy to explain, it may be a good idea.Namespaces are one honking great idea – let’s do more of those!

And shorthand for links:

You can add headings using Markdown’s syntax:

Embedded code¶

You can embed code meant for illustration instead of execution in Python:

or other languages:

LaTeX equations¶

Courtesy of MathJax, you can include mathematical expressions both inline:(e^{ipi} + 1 = 0) and displayed:

Use single dolars delimiter for inline math, so $thisisinlineintmath$ will give (this is inlineint math), for example to refer to variable within text.

Double dollars $$int_0^{2pi}f(r,phi)partialphi$$ is used for standalone formulas:

[int_0^{2pi} f(r, phi) partial phi ]

Github flavored markdown (GFM)¶

The Notebook webapp support Github flavored markdown meaning that you can use triple backticks for code blocks

Gives

And a table like this :

A nice HTML Table

This

is

a

table

Jupyter Notebook Itemize

General HTML¶

Because Markdown is a superset of HTML you can even add things like HTML tables:

Header 1Header 2
row 1, cell 1row 1, cell 2
row 2, cell 1row 2, cell 2

Typesetting Equations¶

The Markdown parser included in IPython is MathJax-aware. This means that you can freely mix in mathematical expressions using the MathJax subset of Tex and LaTeX.

You can use single-dollar signs to include inline math, e.g. $e^{ipi}=-1$ will render as (e^{i pi} = -1), and double-dollars for displayed math:

Port Number Check a port's status by entering an address and port number above. The open port checker is a tool you can use to check your external IP address and detect open ports on your connection. This tool is useful for finding out if your port forwarding is setup correctly or if your server applications are being blocked by a firewall. Scanning by numeric range, select 'range', input a valid port number to start, input another valid port number to stop, and select 'Scan'. The Port Scanner Tool will then display the status of each port between and including the starting and ending ports below the scan button. My ip address ipv4 and port. Check whether a port is open or closed, quickly and easily. Check for an Open Port. Albuquerque Real Estate. IP Address: Port: Enter the IP address of the machine you wish to check into the 'IP Address' field (if the IP isn't already there) then enter the desired port into the 'Port' field and hit the enter or return key or click the check button. Your IP address is: 207.46.13.123 copy. Host: 172.69.34.64. Remote Port: 65482. ISP: Microsoft Corporation. Country: United States. The internet is a big network of connected devices, every device has a unique address where others can send information when they want to communicate. This unique identifier is your IP address and it is. Most residential ISP's block ports to combat viruses and spam. The most commonly blocked ports are port 80 and port 25. Port 80 is the default port for http traffic. With blocked port 80 you will need to run your web server on a non-standard port.

renders as:

[e^x=sum_{i=0}^infty frac{1}{i!}x^i]

You can also use more complex LaTeX constructs for displaying math, such as:

to produce the Lorenz equations:

begin{align}dot{x} & = sigma(y-x) dot{y} & = rho x - y - xz dot{z} & = -beta z + xyend{align}

Please refer to the MathJax documentation for a comprehensive description of which parts of LaTeX are supported, but note that Jupyter’s support for LaTeX is limited to mathematics. You can not use LaTeX typesetting constrcuts for text or document structure, for text formatting you should restrict yourself to Markdown syntax.