PeterJohnPyTorch

Now You Can Use " PyTorch " on your iPhone even when you are in the train
or when your iPhone is OffLine.

****Why we Need " PyTorch " on the Edge Device such as iPhone??;
When "Torch" is a Lamp, "iPhone" becomes a Lamp Stand.
even When you are in the train or when your iPhone is OffLine.
So doNot put "Torch" on any Basket ( Hidden Place ) but put on your "iPhone".
So that the Light of the Lamp will Shine Before Others.
Scripture( Matthew 5:13;14-16 ) Says, 
When the Light is Put on the Hill,
the City on the Hill canNot be Hidden.

****Matthew 5:13;14-16, ESV;
5:13 “You are the salt of the earth, but if salt has lost its taste,
how shall its saltiness be restored?
5:14 “You are the light of the world. A city set on a hill canNot be hidden.
5:15 Nor do people light a lamp and put it under a basket, but on a stand,
and it gives light to all in the house.
5:16 In the same way, let your light shine before others,
so that they may see your good works
and give glory to your Father who is in heaven.

****TutorialSeason007;
We Prepared some of Examples
to tell you what you Can do Using PeterJohnPyTorch.
s001QuestAnswerLibTorch.py;
This isNot PyTorch but just LibTorch.
QuestionAnswering Demo with LibTorch.
You canNot Customize almost Anything
'cause LibTorch is Called Via Swift
and 'cause Swift Needs to be Compiled
with XCode on MacOS.
This example Loads any Model from "qa360_quantized.ptl" file,
which includes "TorchScript".

s002ProvisionPyTorchTensor.py;
This Shows PeterJohnPyTorch Can Use Tensor.
s003ProvisionPyTorchAutoGradFoundation.py;
This Shows PeterJohnPyTorch Can Use AutoGrad.
s004ProvisionPyTorchAutoGrad.py;
This Shows PeterJohnPyTorch Can Use AutoGrad.
s005ProvisionPyTorchNN.py;
This Shows PeterJohnPyTorch Can Use torch.nn (NeuralNetwork).
s006ProvisionPyTorchNNoptimizer.py;
This Shows PeterJohnPyTorch Can Use torch.nn (NeuralNetwork)
and Optimizer.
This Uses SGD (Stochastic Gradient Descent ) as the Optimizer.
s007QuestAnswerPyTorch.py;
Now you Can See Not libTorch demo But PyTorch demo
about QuestionAnswering.
You can Customize, for example, Tokenizer
in "pjQuestionAnswering.py"
Using PyTorch on iPhone.
This example Loads any Model from "qa360_quantized.ptl" file,
which includes "TorchScript".

s008QuestAnswerTransformers.py;
QuestionAnswering Demo with PyTorch and Transformers.
After you touched "Run Script",
This example begins to Download "model.safetensors"(265.5MBytes),
We Recommend that you make a copy of "model.safetensors",
outside of this App "PeterJohnPyTorch",
using Apple's "Files.app".
So that, Even if you uninstalled this App,
After you installed this App "PeterJohnPyTorch" Again,
you can put back "model.safetensors" file to "/images" directory
of this App "PeterJohnPyTorch".
This example Loads any Model from "model.safetensors" file,
which is the Standard format of "HuggingFace".

****Some of Restrictions that We know Currently;
1) CanNot Trace any Model files using torch.jit.trace() Function;
Since Now "PeterJohnPyTorch" canNot Create any Traced Model,
Also it canNot Create either ".ptl"("PyTorch Lite" format) file 
Nor ".pt"("PyTorch" format) file right now.
2) CanNot Script any Model files using torch.jit.script() Function;
Since Now "PeterJohnPyTorch" canNot Create any Scripted Model,
Also it canNot Create either ".ptl"("PyTorch Lite" format) file
Nor ".pt"("PyTorch" format) file right now.
Now you Need to
save any Model as "model.safetensors",
and use the Model via PyTorch or via Transformers,
Means Write the Logic via PyTorch or via Transformers.
3) Not Implement "MPS" (Metal Performance Shader) backends Yet;
So Now you Need to Specify "CPU" as Device.
The "CPU" backends is just the First Step Before the "GPU" backends.

****
Enjoy PeterJohnPyTorch even when you are in the train
or your iPhone is OffLIne.
--Yasushi Yassun Obata

更新履歴
In this Version ( 2024.0912.0830 ), 
PeterJohnPyTorch Can Use MPS backend.
( Metal Performance Shaders )


Try the example below.
****What we prepared as an Example at this time.
TutorialSeason007/s009MpsAppearsFasterThanCpu.py

**"PeterJohnPyTorch" MPS backend is Compatible with Even iPhone6S Plus(A9 Chip);
It was easier to make MPS backend Available with iPhoneXR( A12 Chip iPhone ),
compared to make MPS backend Available with iPhone6S Plus( A9 Chip iPhone ).
It was Difficult to make MPS backend Available with A9 Chip iPhone,
it seemed "Mission impossible".
But, when we are the Weakest,
Glorious Father gives us the Strongest Mercy and Grace.
At the last, we could succeed to make MPS backend Available with A9 Chip iPhone.
Thank you Lord, Thank you Glorious Father.

****2 Corinthians 12:7-10, ESV;
12:7 So to keep me from becoming conceited 
because of the surpassing greatness of the revelations,
a thorn was given me in the flesh, a messenger of Satan to harass me, 
to keep me from becoming conceited. 
12:8 Three times I pleaded with the Lord about this, that it should leave me. 
12:9 But he said to me, 
“My grace is sufficient for you, for my power is made perfect in weakness.” 
Therefore I will boast all the more gladly of my weaknesses, 
so that the power of Christ may rest upon me. 
12:10 For the sake of Christ, then, I am content with weaknesses, 
insults, hardships, persecutions, and calamities. 
For when I am weak, then I am strong.

Best Regards,
--Yasushi Yassun Obata