Author Topic: Symlinking in the mirror  (Read 1493 times)

0 Members and 1 Guest are viewing this topic.

Offline Strit

  • Maintainer
  • ***
  • Posts: 746
  • Manjaro Torrent Maintainer
    • Strits.dk
  • Branch: Stable
  • Desktop: XFCE
  • GPU Card: GTX 760 OC
  • GPU driver: Non-free nvidia 361
  • Kernel: 4.4.8-1-MANJARO
  • Skill: Intermediate
Symlinking in the mirror
« on: 16. September 2015, 18:21:35 »
Hello all.

I'm trying to get a better understanding of how mirrors and repo's work, and I know that all packages in the manjaro mirror repo's are symlinked to files in the "pool" folder.

If one where to create and remove symlinks manually for each package when it gets updated, there wouldn't be enough hours in a day. So I assume there's a script or program that can do this.

What program does this for the manjaro repository?
If it's not a program, what does the script look like, so I can replicate it?
If it's non of the above, how do the Manjaro team manage it then?
Desktop PC: Manjaro XFCE 15.12 (stable, kernel 4.4)
Private Laptop: Manjaro Strit 16.03 (unstable, kernel 4.6)
Work Laptop: Manjaro Strit 16.03 (stable, kernel 4.4)
Netbook: Arch Linux XFCE/LXqt (i686, kernel 4.0)

Offline handy

  • Global Moderator
  • *****
  • Posts: 5738
  • Desktop: Openbox 3.6.1-3 & Worker :)
  • GPU Card: intel...
  • GPU driver: open-source
  • Kernel: OpenBSD
  • Skill: Intermediate
Re: Symlinking in the mirror
« Reply #1 on: 16. September 2015, 18:27:32 »
You need to read this stuff:

https://wiki.archlinux.org/index.php/Pacman

& don't forget to have a look at these too:

https://wiki.archlinux.org/index.php/Pacman#See_also
The ultimate tyranny in a society is not control
by martial law. It is control by the psychological
manipulation of consciousness, through which reality
is defined so that those who exist within do not even
realize that they are in prison.
  —  Barbara Marciniak

Offline Strit

  • Maintainer
  • ***
  • Posts: 746
  • Manjaro Torrent Maintainer
    • Strits.dk
  • Branch: Stable
  • Desktop: XFCE
  • GPU Card: GTX 760 OC
  • GPU driver: Non-free nvidia 361
  • Kernel: 4.4.8-1-MANJARO
  • Skill: Intermediate
Re: Symlinking in the mirror
« Reply #2 on: 16. September 2015, 18:37:38 »
Can you specify which part of these links give info on how to do symlinking in a repo when the packages in the repo gets updated?
I can't seem to find anything relevant in them.

I don't need to know how to update my packages with pacman, I know that one. :P I'm beginning to maintain my own repo with packages, and want to know how to keep the symlinks up to date as the repo gets updated. :P
Desktop PC: Manjaro XFCE 15.12 (stable, kernel 4.4)
Private Laptop: Manjaro Strit 16.03 (unstable, kernel 4.6)
Work Laptop: Manjaro Strit 16.03 (stable, kernel 4.4)
Netbook: Arch Linux XFCE/LXqt (i686, kernel 4.0)

Offline handy

  • Global Moderator
  • *****
  • Posts: 5738
  • Desktop: Openbox 3.6.1-3 & Worker :)
  • GPU Card: intel...
  • GPU driver: open-source
  • Kernel: OpenBSD
  • Skill: Intermediate
Re: Symlinking in the mirror
« Reply #3 on: 16. September 2015, 18:40:31 »
Talk to Rob.
The ultimate tyranny in a society is not control
by martial law. It is control by the psychological
manipulation of consciousness, through which reality
is defined so that those who exist within do not even
realize that they are in prison.
  —  Barbara Marciniak

Offline Strit

  • Maintainer
  • ***
  • Posts: 746
  • Manjaro Torrent Maintainer
    • Strits.dk
  • Branch: Stable
  • Desktop: XFCE
  • GPU Card: GTX 760 OC
  • GPU driver: Non-free nvidia 361
  • Kernel: 4.4.8-1-MANJARO
  • Skill: Intermediate
Re: Symlinking in the mirror
« Reply #4 on: 16. September 2015, 19:15:21 »
Hoping he might see this topic at some point. :P

I'm just curious, because I want to do the same in my repo. Right now, all my "any" packages are physically in all the architecture folders. :P
Desktop PC: Manjaro XFCE 15.12 (stable, kernel 4.4)
Private Laptop: Manjaro Strit 16.03 (unstable, kernel 4.6)
Work Laptop: Manjaro Strit 16.03 (stable, kernel 4.4)
Netbook: Arch Linux XFCE/LXqt (i686, kernel 4.0)

Offline Strit

  • Maintainer
  • ***
  • Posts: 746
  • Manjaro Torrent Maintainer
    • Strits.dk
  • Branch: Stable
  • Desktop: XFCE
  • GPU Card: GTX 760 OC
  • GPU driver: Non-free nvidia 361
  • Kernel: 4.4.8-1-MANJARO
  • Skill: Intermediate
Re: Symlinking in the mirror
« Reply #5 on: 17. September 2015, 12:29:45 »
Talked to ringo32 on IRC last night. He said that the Manjaro Team uses a program called BoxIt for managing the manjaro repo, which creates symlinks somehow.
Desktop PC: Manjaro XFCE 15.12 (stable, kernel 4.4)
Private Laptop: Manjaro Strit 16.03 (unstable, kernel 4.6)
Work Laptop: Manjaro Strit 16.03 (stable, kernel 4.4)
Netbook: Arch Linux XFCE/LXqt (i686, kernel 4.0)

Offline telephone

  • Jr. Mitglied
  • **
  • Posts: 90
  • Desktop: Xfce
  • Skill: Advanced
Re: Symlinking in the mirror
« Reply #6 on: 17. September 2015, 20:21:18 »
Talked to ringo32 on IRC last night. He said that the Manjaro Team uses a program called BoxIt for managing the manjaro repo, which creates symlinks somehow.

https://github.com/manjaro/boxit

Offline philm

  • Core Team
  • *****
  • Posts: 10671
    • Manjaro Linux
  • Branch: Unstable
  • Desktop: XFCE
  • GPU Card: Geforce GTX 650
  • GPU driver: non-free
  • Kernel: Maintainer - so all ;)
  • Skill: Guru
Re: Symlinking in the mirror
« Reply #7 on: 21. September 2015, 09:50:12 »
We use boxit. It is a server and client solution. It supports branches and is designed like git. However it is not needed for your repository. Simply use the given tools by pacman. Therefor use repo-add. It allows you even to delete old packages. If you really want to give boxit a try then you have to install it on Arch or any Debian server first. If you need help for configuration write me an email.

Offline Strit

  • Maintainer
  • ***
  • Posts: 746
  • Manjaro Torrent Maintainer
    • Strits.dk
  • Branch: Stable
  • Desktop: XFCE
  • GPU Card: GTX 760 OC
  • GPU driver: Non-free nvidia 361
  • Kernel: 4.4.8-1-MANJARO
  • Skill: Intermediate
Re: Symlinking in the mirror
« Reply #8 on: 23. September 2015, 09:11:05 »
Hi philm. Thanks for responding. :)

I think BoxIt is not the solution for my little repo. But I do want to know if repo-add can symlink from one folder to another, like you are doing in yours?

I know how to update my repo database with repo-add, and it makes it quite easy to maintain my own repo.
Now, if I could only symlink some packages to reduce the size, in an easy way, that would be awesome. :)
Desktop PC: Manjaro XFCE 15.12 (stable, kernel 4.4)
Private Laptop: Manjaro Strit 16.03 (unstable, kernel 4.6)
Work Laptop: Manjaro Strit 16.03 (stable, kernel 4.4)
Netbook: Arch Linux XFCE/LXqt (i686, kernel 4.0)