add explicit invocation of fontspec and Source Code Pro #537

mpacer · 2017-02-22T02:56:34Z

This makes unicode characters more generally available in plaintext.

It doesn't technically handle #533 (although it does now seem to catch the combining characters), since it doesn't address the monospace font issue.

@Ken-B could you check to see whether you also see the â because that (now) does seem to work locally for me.

Ken-B · 2017-02-22T09:35:48Z

@michaelpacer I'm not an expert on this, so maybe I did something wrong.

Anyway, here's the output of my testpdf:
in math mode: β̂
in unicode: a=1 â=2 β=3 β̂=4
directly in mathmode: =5
in verbatim block ̂ = 6

In [ ]: # 
a=1
â=2  
=3 
 ̂ = 4

So there is some progress, as unicode in markdown cells now output correctly! :)
Unicode in mathmode is still missing (not so important, I'd say).

However, in verbatim and code cells, the hat now appears, but nothing under it. Strange.

By the way, I installed with pip install -e . but the tests don't pass (see output in this gist). I hope this helps.

Carreau · 2017-02-22T18:42:25Z

Palatino does not seem to be installed on travis.

mpacer · 2017-02-24T01:41:51Z

@Ken-B So now the markdown stuff probably won't work, but it should work for the monospace font.

The combining character doesn't actually combine, but I don't know how many fonts will be able to support that. Regardless, I figure this is a big enough improvement it's worth including even if its not enough.

For details about what's going on check out: http://tex.stackexchange.com/questions/355081/fonts-using-xetex-why-do-fontspec-and-setmonofont-versus-sourcecodepro-differ/355269?noredirect=1#comment874662_355269

Ken-B · 2017-02-24T21:44:38Z

I'm now getting these crossed boxes where the β should be, see image below. I guess it indicates a font missing?
I installed again with pip install -e . but should I download some special font or adjust some setting?

mpacer · 2017-02-27T22:46:51Z

@Ken-B I'm specifically trying to avoid anyone needing to download a custom font, so no, the more barebones your system the easier it will be for me to ensure that I'm not relying on my local setup to solve these problems.

Ken-B · 2017-02-27T23:02:48Z

@michaelpacer Ok. I just tested again and got the same output as last time (with the crossed boxes). I'm on osx 10.12.3 by the way.

Let me know what I can do to help.

mpacer · 2017-02-27T23:23:23Z

@Ken-B first try a conversion to .tex and then use XeLaTeX directly, I added some debugging statements to the template that should dump information to the .log file; what version of the font is it finding for you?

mpacer · 2017-02-28T00:11:48Z

@Ken-B If you run the tests on your end, are they failing?

Ken-B · 2017-02-28T09:12:05Z

Good morning, @michaelpacer ,

With 5f5d297 it errors because it can't find the Tex Gyre Pagella font (full output here)

The latest (a177dd3) gives following output:

So unicode output is back, but still nothing in the code cells.

This is running jupyter-nbconvert --to pdf.
If I first convert to latex and then run xelatex, I get a LaTeX Font warning (log file here).

The nbconvert tests have 3 fails for test_latex and 1 test_pdf. See output here.

I'm impressed with the efforts here, I feel we're getting closer, thanks! :)

…etex-not-working-on-ubuntu-10-04

…atino)

…ey're set explicitly

…ng &c.

Ken-B · 2017-03-07T16:35:00Z

@michaelpacer , your latest commit 059b0b5 fails locally with output below. Let me know what I can do to help.

(/usr/local/texlive/2015/texmf-dist/tex/latex/unicode-math/unicode-math-table.t
ex)))
kpathsea: Running mktextfm texgyrepagella
mktextfm: Running mf-nowin -progname=mf \mode:=ljfour; mag:=1; nonstopmode; input texgyrepagella
This is METAFONT, Version 2.7182818 (TeX Live 2015) (preloaded base=mf)

kpathsea: Running mktexmf texgyrepagella

! I can't find file `texgyrepagella'.
<*> ...; mag:=1; nonstopmode; input texgyrepagella
                                                  
Please type another input file name
! Emergency stop.
<*> ...; mag:=1; nonstopmode; input texgyrepagella
                                                  
Transcript written on mfput.log.
grep: texgyrepagella.log: No such file or directory
mktextfm: `mf-nowin -progname=mf \mode:=ljfour; mag:=1; nonstopmode; input texgyrepagella' failed to make texgyrepagella.tfm.
kpathsea: Appending font creation commands to missfont.log.

*************************************************
* fontspec warning: "icu-feature-not-exist-in-font"
* 
* OpenType feature 'Numbers=OldStyle,Monospaced' (+tnum) not available for
* font 'SourceCodePro-Regular' with script 'Latin' and language 'Default'.
*************************************************
*************************************************
* fontspec warning: "icu-feature-not-exist-in-font"
* 
* OpenType feature 'Numbers=OldStyle,Monospaced' (+tnum) not available for
* font 'SourceCodePro-Regular' with script 'Latin' and language 'Default'.
*************************************************
*************************************************
* fontspec warning: "icu-feature-not-exist-in-font"
* 
* OpenType feature 'Numbers=OldStyle,Monospaced' (+tnum) not available for
* font 'SourceCodePro-Bold' with script 'Latin' and language 'Default'.
*************************************************

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
!
! fontspec error: "font-not-found"
! 
! The font "texgyrepagella" cannot be found.
! 
! See the fontspec documentation for further information.
! 
! For immediate help type H <return>.
!...............................................  
                                                  
l.32 ...hsfont(Latin,Greek,Digits){texgyrepagella}
                                                  
? 
! Emergency stop.
!...............................................  
                                                  
l.32 ...hsfont(Latin,Greek,Digits){texgyrepagella}
                                                  
No pages of output.
Transcript written on notebook.log.

mpacer · 2017-03-07T18:00:54Z

@Ken-B: Could you switch that line to use `\usepackage{tgpagella}` and use the `\XeTeXtracingfonts` to tell me what the name of the texgyrepagella fonts is on your system?

…

On Tue, Mar 7, 2017 at 8:35 AM, Ken-B ***@***.***> wrote: @michaelpacer <https://github.com/michaelpacer> , your latest commit 059b0b5 <059b0b5> fails locally with output below. Let me know what I can do to help. (/usr/local/texlive/2015/texmf-dist/tex/latex/unicode-math/unicode-math-table.t ex))) kpathsea: Running mktextfm texgyrepagella mktextfm: Running mf-nowin -progname=mf \mode:=ljfour; mag:=1; nonstopmode; input texgyrepagella This is METAFONT, Version 2.7182818 (TeX Live 2015) (preloaded base=mf) kpathsea: Running mktexmf texgyrepagella ! I can't find file `texgyrepagella'. <*> ...; mag:=1; nonstopmode; input texgyrepagella Please type another input file name ! Emergency stop. <*> ...; mag:=1; nonstopmode; input texgyrepagella Transcript written on mfput.log. grep: texgyrepagella.log: No such file or directory mktextfm: `mf-nowin -progname=mf \mode:=ljfour; mag:=1; nonstopmode; input texgyrepagella' failed to make texgyrepagella.tfm. kpathsea: Appending font creation commands to missfont.log. ************************************************* * fontspec warning: "icu-feature-not-exist-in-font" * * OpenType feature 'Numbers=OldStyle,Monospaced' (+tnum) not available for * font 'SourceCodePro-Regular' with script 'Latin' and language 'Default'. ************************************************* ************************************************* * fontspec warning: "icu-feature-not-exist-in-font" * * OpenType feature 'Numbers=OldStyle,Monospaced' (+tnum) not available for * font 'SourceCodePro-Regular' with script 'Latin' and language 'Default'. ************************************************* ************************************************* * fontspec warning: "icu-feature-not-exist-in-font" * * OpenType feature 'Numbers=OldStyle,Monospaced' (+tnum) not available for * font 'SourceCodePro-Bold' with script 'Latin' and language 'Default'. ************************************************* !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! ! ! fontspec error: "font-not-found" ! ! The font "texgyrepagella" cannot be found. ! ! See the fontspec documentation for further information. ! ! For immediate help type H <return>. !............................................... l.32 ...hsfont(Latin,Greek,Digits){texgyrepagella} ? ! Emergency stop. !............................................... l.32 ...hsfont(Latin,Greek,Digits){texgyrepagella} No pages of output. Transcript written on notebook.log. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#537 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/ACXg6NyN0y9UFKci-NKpBpPFh7co_qIJks5rjYc1gaJpZM4MIJQm> .

Ken-B · 2017-03-07T22:08:08Z

I've added the \usepackage{tgpagella} on line 20 of base.tplx. Also adding \XeTeXtracingfonts gave an error, I guess because it's also used above on line 17.
I have no idea what this all does as I have zero experience with this, but I'm happy to test things out!

Afterwards it threw a different error message (it doesn't seem to write the log anymore).

(/usr/local/texlive/2015/texmf-dist/tex/generic/oberdiek/kvsetkeys.sty)))kpathsea:make_tex: Invalid fontname `TeX Gyre Pagella Math', contains ' '


LaTeX Font Warning: Font shape `EU1/qpl/m/n' undefined
(Font)              using `EU1/lmr/m/n' instead on input line 27.

*************************************************
* fontspec warning: "icu-feature-not-exist-in-font"
* 
* OpenType feature 'Numbers=OldStyle,Monospaced' (+tnum) not available for
* font 'SourceCodePro-Regular' with script 'Latin' and language 'Default'.
*************************************************
*************************************************
* fontspec warning: "icu-feature-not-exist-in-font"
* 
* OpenType feature 'Numbers=OldStyle,Monospaced' (+tnum) not available for
* font 'SourceCodePro-Regular' with script 'Latin' and language 'Default'.
*************************************************
*************************************************
* fontspec warning: "icu-feature-not-exist-in-font"
* 
* OpenType feature 'Numbers=OldStyle,Monospaced' (+tnum) not available for
* font 'SourceCodePro-Bold' with script 'Latin' and language 'Default'.
*************************************************

!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
!
! fontspec error: "font-not-found"
! 
! The font "TeX Gyre Pagella Math" cannot be found.
! 
! See the fontspec documentation for further information.
! 
! For immediate help type H <return>.
!...............................................  
                                                  
l.33 ...Latin,Greek,Digits){TeX Gyre Pagella Math}
                                                  
? 
! Emergency stop.
!...............................................  
                                                  
l.33 ...Latin,Greek,Digits){TeX Gyre Pagella Math}
                                                  
No pages of output.
Transcript written on notebook.log.

Ken-B · 2017-03-12T20:17:39Z

@michaelpacer anything I can do to help? Does it work for you locally?

mpacer · 2017-03-12T21:29:00Z

Hi @Ken-B what I pushed works locally, however I have a really up to date tex live (in that I just upgraded all the packages) I'm wondering if the font features that have been distributed with those fonts differ between the years Comment the font declarations that are failing in your TeX file and only use the tgpagella package and then tell me what it's font loading commands are. Sorry that this is taking so long but figuring all of this out in a system agnostic way is proving to be much more challenging than I expected.

…

On Sun, Mar 12, 2017 at 13:17 Ken-B ***@***.***> wrote: @michaelpacer <https://github.com/michaelpacer> anything I can do to help? Does it work for you locally? — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#537 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/ACXg6Hb1lOYGZvDEkO3J833jwLMdxHWlks5rlFLjgaJpZM4MIJQm> .

Ken-B · 2018-04-06T00:47:54Z

@mpacer There was an informative post on the julia forum on typesetting with unicode for latex that might help with this issue:
https://discourse.julialang.org/t/typesetting-julia-code-in-latex-documents-unicode/10176
Again, happy to test and assist where possible.
Best,
Ken

mpacer force-pushed the font_issues branch from 500fbfd to 69cc655 Compare February 24, 2017 01:39

mpacer changed the title ~~add explicit invocation of fontspec and palatino~~ add explicit invocation of fontspec and Source Code Pro Feb 24, 2017

mpacer force-pushed the font_issues branch from d67d29c to 2b262ea Compare February 27, 2017 23:20

mpacer force-pushed the font_issues branch 2 times, most recently from 5683ba7 to a177dd3 Compare February 28, 2017 07:54

mpacer added 16 commits March 6, 2017 11:13

add explicit invocation of fontspec and palatino

379f3c7

try adding solution from http://tex.stackexchange.com/questions/652/x…

dd66340

…etex-not-working-on-ubuntu-10-04

Fix monospace, lose roman unicode characters (don't expicitly use pal…

de8ff4d

…atino)

See if travis can find sourcecodepro

aca713d

WIP, lots of changes, some debugging commands for log

078dc85

Add sourcecodePro back into the mix

35c0d0b

Remove italic monospace font calls, they do not exist on trusty

c6ba608

remove indentation from verbatim calls to see if that's the issue

965766d

In case not having set the numbers explicitly was the problem, now th…

38a3333

…ey're set explicitly

does verbatim complain without monofont?

bad1acd

If we give specific values to numbers include monospaced does that work?

beb9217

sourcecodepro the package

57915d0

change mainfont to be arial and try using setmonofont again

98d5aef

Try using a font that it can find

6e70099

actually follow the spec described in the docs

db4d94a

tiny change to spacing and order that really shouldn't matter

5826911

Tried to provide unicode math support, found issues with option spaci…

1545f71

…ng &c.

mpacer force-pushed the font_issues branch from a177dd3 to 1545f71 Compare March 7, 2017 01:21

Ok, hopefully this works?

059b0b5

mpacer mentioned this pull request Mar 7, 2017

Latex base template: remove \usepackage[utf8x]{inputenc} #530

Open

mpacer mentioned this pull request Mar 30, 2017

Unicode in markdown cells #560

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

add explicit invocation of fontspec and Source Code Pro #537

add explicit invocation of fontspec and Source Code Pro #537

mpacer commented Feb 22, 2017 •

edited

Ken-B commented Feb 22, 2017 •

edited

Carreau commented Feb 22, 2017

mpacer commented Feb 24, 2017

Ken-B commented Feb 24, 2017

mpacer commented Feb 27, 2017

Ken-B commented Feb 27, 2017

mpacer commented Feb 27, 2017

mpacer commented Feb 28, 2017

Ken-B commented Feb 28, 2017

Ken-B commented Mar 7, 2017

mpacer commented Mar 7, 2017 via email

Ken-B commented Mar 7, 2017

Ken-B commented Mar 12, 2017

mpacer commented Mar 12, 2017 via email

Ken-B commented Apr 6, 2018

add explicit invocation of fontspec and Source Code Pro #537

Are you sure you want to change the base?

add explicit invocation of fontspec and Source Code Pro #537

Conversation

mpacer commented Feb 22, 2017 • edited

Ken-B commented Feb 22, 2017 • edited

Carreau commented Feb 22, 2017

mpacer commented Feb 24, 2017

Ken-B commented Feb 24, 2017

mpacer commented Feb 27, 2017

Ken-B commented Feb 27, 2017

mpacer commented Feb 27, 2017

mpacer commented Feb 28, 2017

Ken-B commented Feb 28, 2017

Ken-B commented Mar 7, 2017

mpacer commented Mar 7, 2017 via email

Ken-B commented Mar 7, 2017

Ken-B commented Mar 12, 2017

mpacer commented Mar 12, 2017 via email

Ken-B commented Apr 6, 2018

mpacer commented Feb 22, 2017 •

edited

Ken-B commented Feb 22, 2017 •

edited