title: Searching for the thinnest metallic wire

abstract: One-dimensional materials have gained much attention in the last decades: from carbon nanotubes to ultrathin nanowires, to few-atom atomic chains, these can all display unique electronic properties and great potential for next-generation applications. Exfoliable bulk materials could naturally provide a source for one-dimensional wires with well defined structure and electronics. Here, we explore a database of one-dimensional materials that could be exfoliated from experimentally known three-dimensional Van-der-Waals compounds, searching metallic wires that are resilient to Peierls distortions and could act as vias or interconnects for future downscaled electronic devices. As the one-dimensional nature makes these wires particularly susceptible to dynamical instabilities, we carefully characterise vibrational properties to identify stable phases and characterize electronic and dynamical properties. Our search identifies several novel and stable wires; notably, we identify what could be the thinnest possible exfoliable metallic wire, CuC$_2$, coming a step closer to the ultimate limit in materials downscaling.


title: Towards Bloodless Potassium Measurement from ECG using Neuro-Fuzzy Systems

abstract: Potassium disorders are generally asymptomatic, potentially lethal, and common in patients with renal or cardiac disease. The morphology of the electrocardiogram (ECG) signal is very sensitive to the changes in potassium ions, so ECG has a high potential for detecting dyskalemias before laboratory results. In this regard, this paper introduces a new system for ECG-based potassium measurement. The proposed system consists of three main steps. First, cohort selection & data labeling were carried out by using a 5- minute interval between ECGs and potassium measurements and defining three labels: hypokalemia, normal, and hyperkalemia. After that, feature extraction & selection were performed. The extracted features are RR interval, PR interval, QRS duration, QT interval, QTc interval, P axis, QRS axis, T axis, and ACCI. Kruskal-Wallis technique was also used to assess the importance of the features and to select discriminative ones. Finally, an ANFIS model based on FCM clustering (FCM-ANFIS) was designed based on the selected features. The used database is ECG-ViEW II. Results showed that T axis compared with other features has a significant relationship with potassium levels (P<0.01, r=0.62). The absolute error of FCM-ANFIS is 0.4+-0.3 mM, its mean absolute percentage error (MAPE) is 9.99%, and its r-squared value is 0.74. Its classification accuracy is 85.71%. In detecting hypokalemia and hyperkalemia, the sensitivities are 60% and 80%, respectively, and the specificities are 100% and 97.3%, respectively. This research has shed light on the design of noninvasive instruments to measure potassium concentration and to detect dyskalemias, thereby reducing cardiac events.


title: Constraining the p{\Lambda} interaction from a combined analysis of scattering data and correlation functions

abstract: This work provides the first combined analysis of low-energy p$\Lambda$ scattering, considering both cross section and correlation data. The obtained results establish the most stringent constraints to date on the two-body p$\Lambda$ interaction, pointing to a weaker attraction than so far accepted. The best set of scattering lengths for the spin singlet and triplet are found to range from $f_0, f_1 = (2.1, 1.56)$ to $(3.34, 1.18)~$fm. With a chiral NY potential fine-tuned to those scattering parameters, the in-medium properties of the $\Lambda$ are explored and a potential depth of $U_\Lambda= -36.3\pm 1.3 \mathrm{(stat)}^{+2.5}_{-6.2}\mathrm{(syst)}$ MeV is found at nuclear matter saturation density.


title: High Throughput Inter-Layer Connecting Strategy for Multi-Layer Ultra-Dense Satellite Networks

abstract: Multi-layer ultra-dense satellite networks (MLUDSNs) have soared this meteoric to provide vast throughputd for globally diverse services. Differing from traditional monolayer constellations, MLUDSNs emphasize the spatial integration among layers, and its throughput may not be simply the sum of throughput of each layer. The hop-count of cross-layer communication paths can be reduced by deploying inter-layer connections (ILCs), augmenting MLUDSN's throughput. Therefore, it remains an open issue how to deploy ILCs to optimize the dynamic MLUDSN topology to dramatically raise throughput gains under multi-layer collaboration. This paper designs an ILC deployment strategy to enhance throughput by revealing the impacts of ILC distribution on reducing hop-count. Since deploying ILCs burdens the satellite with extra communication resource consumption, we model the ILC deployment problem as minimizing the average hop with limited ILCs, to maximize throughput. The proposed problem is a typical integer linear programming (ILP) problem, of which computational complexity is exponential as the satellite scale expands and the time evolves. Based on the symmetrical topology of each layer, we propose a two-phase deployment scheme to halve the problem scale and prioritize stable ILCs to reduce handover-count, which decreases the exponential complexity to a polynomial one, with 1% estimation error: Simulation results based on realistic megaconstellation information confirm that the optimal number of ILCs is less than P.S/2, where P and S are orbits and satellites per orbit. Besides, these ILCs deploy uniformly in each layer, which raises over 1.55x throughput than isolated layers.


title: Neutrino Mass Measurement with Cosmic Gravitational Focusing

abstract: We thoroughly explore the cosmic gravitational focusing of cosmic neutrino fluid (C$\nu$F) by dark matter (DM) halo using both general relativity for a point source of gravitational potential and Boltzmann equations for continuous overdensities. Derived in the most general way for both relativistic and non-relativistic neutrinos, our results show that the effect has fourth power dependence on the neutrino mass and temperature. With nonlinear mass dependence which is different from the cosmic microwave background (CMB) and large scale structure (LSS) observations, the cosmic gravitational focusing can provide an independent cosmological way of measuring the neutrino mass and ordering. We take DESI as an example to illustrate that the projected sensitivity as well as its synergy with existing terrestrial neutrino oscillation experiments and other cosmological observations can significantly improve the neutrino mass measurement.


title: Live Objects All The Way Down: Removing the Barriers between Applications and Virtual Machines

abstract: Object-oriented languages often use virtual machines (VMs) that provide mechanisms such as just-in-time (JIT) compilation and garbage collection (GC). These VM components are typically implemented in a separate layer, isolating them from the application. While this approach brings the software engineering benefits of clear separation and decoupling, it introduces barriers for both understanding VM behavior and evolving the VM implementation. For example, the GC and JIT compiler are typically fixed at VM build time, limiting arbitrary adaptation at run time. Furthermore, because of this separation, the implementation of the VM cannot typically be inspected and debugged in the same way as application code, enshrining a distinction in easy-to-work-with application and hard-to-work-with VM code. These characteristics pose a barrier for application developers to understand the engine on top of which their own code runs, and fosters a knowledge gap that prevents application developers to change the VM. We propose Live Metacircular Runtimes (LMRs) to overcome this problem. LMRs are language runtime systems that seamlessly integrate the VM into the application in live programming environments. Unlike classic metacircular approaches, we propose to completely remove the separation between application and VM. By systematically applying object-oriented design to VM components, we can build live runtime systems that are small and flexible enough, where VM engineers can benefit of live programming features such as short feedback loops, and application developers with fewer VM expertise can benefit of the stronger causal connections between their programs and the VM implementation. To evaluate our proposal, we implemented Bee/LMR, a live VM for a Smalltalk-derivative environment in 22057 lines of code. We analyze case studies on tuning the garbage collector, avoiding recompilations by the just-in-time compiler, and adding support to optimize code with vector instructions to demonstrate the trade-offs of extending exploratory programming to VM development in the context of an industrial application used in production. Based on the case studies, we illustrate how our approach facilitates the daily development work of a small team of application developers. Our approach enables VM developers to gain access to live programming tools traditionally reserved for application developers, while application developers can interact with the VM and modify it using the high-level tools they use every day. Both application and VM developers can seamlessly inspect, debug, understand, and modify the different parts of the VM with shorter feedback loops and higher-level tools.


title: Families of subvarieties of manifolds with a canonical form

abstract: Suppose $Y$ is a smooth variety equipped with a top form. We prove a simple theorem giving a sharp lower bound on the geometric genus of a family of subvarieties of $Y$, in terms of the dimension of this family. Two elementary applications are presented. On the one hand, we show that for a very general curve $C$ and a very general hypersurface $Y\subset \mathbb P^{n+1}$ of degree $\ge 2n+1$, any map $C \to Y$ is constant. On the other hand, we give a lower bound on the genus of a family of curves with an isotrivial factor in the associated family of Jacobians; we also characterize the families of curves attaining this bound as the families of degree $2$ branched covers of a fixed curve.


title: Few-shot learning for automated content analysis: Efficient coding of arguments and claims in the debate on arms deliveries to Ukraine

abstract: Pre-trained language models (PLM) based on transformer neural networks developed in the field of natural language processing (NLP) offer great opportunities to improve automatic content analysis in communication science, especially for the coding of complex semantic categories in large datasets via supervised machine learning. However, three characteristics so far impeded the widespread adoption of the methods in the applying disciplines: the dominance of English language models in NLP research, the necessary computing resources, and the effort required to produce training data to fine-tune PLMs. In this study, we address these challenges by using a multilingual transformer model in combination with the adapter extension to transformers, and few-shot learning methods. We test our approach on a realistic use case from communication science to automatically detect claims and arguments together with their stance in the German news debate on arms deliveries to Ukraine. In three experiments, we evaluate (1) data preprocessing strategies and model variants for this task, (2) the performance of different few-shot learning methods, and (3) how well the best setup performs on varying training set sizes in terms of validity, reliability, replicability and reproducibility of the results. We find that our proposed combination of transformer adapters with pattern exploiting training provides a parameter-efficient and easily shareable alternative to fully fine-tuning PLMs. It performs on par in terms of validity, while overall, provides better properties for application in communication studies. The results also show that pre-fine-tuning for a task on a near-domain dataset leads to substantial improvement, in particular in the few-shot setting. Further, the results indicate that it is useful to bias the dataset away from the viewpoints of specific prominent individuals.


title: $E$-unitary and $F$-inverse monoids, and closure operators on group Cayley graphs

abstract: We show that the category of $X$-generated $E$-unitary inverse monoids with greatest group image $G$ is equivalent to the category of $G$-invariant, finitary closure operators on the set of connected subgraphs of the Cayley graph of $G$. Analogously, we study $F$-inverse monoids in the extended signature $(\cdot, 1, ^{-1}, ^\mathfrak{m})$, and show that the category of $X$-generated $F$-inverse monoids with greatest group image $G$ is equivalent to the category of $G$-invariant, finitary closure operators on the set of all subgraphs of the Cayley graph of $G$. As an application, we show that presentations of $F$-inverse monoids in the extended signature can be studied by tools analogous to Stephen's procedure in inverse monoids, in particular, we introduce the notions of $F$-Sch\"utzenberger graphs and $P$-expansions.


title: Provably Fair Cooperative Scheduling

abstract: The context of this work is cooperative scheduling, a concurrency paradigm, where task execution is not arbitrarily preempted. Instead, language constructs exist that let a task voluntarily yield the right to execute to another task. The inquiry is the design of provably fair schedulers and suitable notions of fairness for cooperative scheduling languages. To the best of our knowledge, this problem has not been addressed so far. Our approach is to study fairness independently from syntactic constructs or environments, purely from the point of view of the semantics of programming languages, i.e., we consider fairness criteria using the formal definition of a program execution. We develop our concepts for classic structural operational semantics (SOS) as well as for the recent locally abstract, globally concrete (LAGC) semantics. The latter is a highly modular approach to semantics ensuring the separation of concerns between local statement evaluation and scheduling decisions. The new knowledge contributed by our work is threefold: first, we show that a new fairness notion, called quiescent fairness, is needed to characterize fairness adequately in the context of cooperative scheduling; second, we define a provably fair scheduler for cooperative scheduling languages; third, a qualitative comparison between the SOS and LAGC versions yields that the latter, while taking higher initial effort, is more amenable to proving fairness and scales better under language extensions than SOS. The grounding of our work is a detailed formal proof of quiescent fairness for the scheduler defined in LAGC semantics. The importance of our work is that it provides a formal foundation for the implementation of fair schedulers for cooperative scheduling languages, an increasingly popular paradigm (for example: akka/Scala, JavaScript, async Rust). Being based solely on semantics, our ideas are widely applicable. Further, our work makes clear that the standard notion of fairness in concurrent languages needs to be adapted for cooperative scheduling and, more generally, for any language that combines atomic execution sequences with some form of preemption.


title: A modified AAA algorithm for learning stable reduced-order models from data

abstract: In recent years, the Adaptive Antoulas-Anderson AAA algorithm has established itself as the method of choice for solving rational approximation problems. Data-driven Model Order Reduction (MOR) of large-scale Linear Time-Invariant (LTI) systems represents one of the many applications in which this algorithm has proven to be successful since it typically generates reduced-order models (ROMs) efficiently and in an automated way. Despite its effectiveness and numerical reliability, the classical AAA algorithm is not guaranteed to return a ROM that retains the same structural features of the underlying dynamical system, such as the stability of the dynamics. In this paper, we propose a novel algebraic characterization for the stability of ROMs with transfer function obeying the AAA barycentric structure. We use this characterization to formulate a set of convex constraints on the free coefficients of the AAA model that, whenever verified, guarantee by construction the asymptotic stability of the resulting ROM. We suggest how to embed such constraints within the AAA optimization routine, and we validate experimentally the effectiveness of the resulting algorithm, named stabAAA, over a set of relevant MOR applications.

categories: math.NA cs.NA cs.SY eess.SY math.DS math.OC


title: BlackboxBench: A Comprehensive Benchmark of Black-box Adversarial Attacks

abstract: Adversarial examples are well-known tools to evaluate the vulnerability of deep neural networks (DNNs). Although lots of adversarial attack algorithms have been developed, it is still challenging in the practical scenario that the model's parameters and architectures are inaccessible to the attacker/evaluator, i.e., black-box adversarial attacks. Due to the practical importance, there has been rapid progress from recent algorithms, reflected by the quick increase in attack success rate and the quick decrease in query numbers to the target model. However, there is a lack of thorough evaluations and comparisons among these algorithms, causing difficulties of tracking the real progress, analyzing advantages and disadvantages of different technical routes, as well as designing future development roadmap of this field. Thus, in this work, we aim at building a comprehensive benchmark of black-box adversarial attacks, called BlackboxBench. It mainly provides: 1) a unified, extensible and modular-based codebase, implementing 25 query-based attack algorithms and 30 transfer-based attack algorithms; 2) comprehensive evaluations: we evaluate the implemented algorithms against several mainstreaming model architectures on 2 widely used datasets (CIFAR-10 and a subset of ImageNet), leading to 14,106 evaluations in total; 3) thorough analysis and new insights, as well analytical tools. The website and source codes of BlackboxBench are available at https://blackboxbench.github.io/ and https://github.com/SCLBD/BlackboxBench/, respectively.


title: 3DTINC: Time-Equivariant Non-Contrastive Learning for Predicting Disease Progression from Longitudinal OCTs

abstract: Self-supervised learning (SSL) has emerged as a powerful technique for improving the efficiency and effectiveness of deep learning models. Contrastive methods are a prominent family of SSL that extract similar representations of two augmented views of an image while pushing away others in the representation space as negatives. However, the state-of-the-art contrastive methods require large batch sizes and augmentations designed for natural images that are impractical for 3D medical images. To address these limitations, we propose a new longitudinal SSL method, 3DTINC, based on non-contrastive learning. It is designed to learn perturbation-invariant features for 3D optical coherence tomography (OCT) volumes, using augmentations specifically designed for OCT. We introduce a new non-contrastive similarity loss term that learns temporal information implicitly from intra-patient scans acquired at different times. Our experiments show that this temporal information is crucial for predicting progression of retinal diseases, such as age-related macular degeneration (AMD). After pretraining with 3DTINC, we evaluated the learned representations and the prognostic models on two large-scale longitudinal datasets of retinal OCTs where we predict the conversion to wet-AMD within a six months interval. Our results demonstrate that each component of our contributions is crucial for learning meaningful representations useful in predicting disease progression from longitudinal volumetric scans.


title: Unified gas-kinetic wave-particle method for frequency-dependent radiation transport equation

abstract: The multi-frequency radiation transport equation (RTE) system models the photon transport and the energy exchange process between the background material and different frequency photons. In this paper, the unified gas-kinetic wave-particle (UGKWP) method for multi-frequency RTE is developed to capture the multiscale non-equilibrium transport in different optical regimes. In the UGKWP, a multiscale evolution process is properly designed to obtain both non-equilibrium transport in the optically thin regime and thermal diffusion process in the optically thick regime automatically. At the same time, the coupled macroscopic energy equations for the photon and material are solved implicitly by the matrix-free source iteration method. With the wave-particle decomposition strategy, the UGKWP method has a dynamic adaptivity for different regime physics. In the optically thick regime, no particles will be sampled in the computational domain and the thermal diffusion solution for the photon transport will be recovered. While in the optically thin regime, stochastic particles will play a dominant role in the evolution and the non-equilibrium free transport of photon is automatically followed. In the frequency-dependent transport, the frequency carried by the simulating particle will be determined by a linear-frequency sampling strategy. In addition, to better resolve the sharp of opacity in the photon transport across a cell interface, the free streaming time of simulating particle in the UGKWP method will be reset when it passes through the interface. Moreover, the numerical relaxation time is properly defined to increase the particle proportion in the sharp opacity transition region in order to avoid numerical oscillation. Several typical test cases for the RTE system have been calculated to demonstrate the accuracy and reliability of the current frequency-dependent UGKWP method.


title: Derived functors and Hilbert polynomials over regular local rings

abstract: Let $(A,\mathfrak{m})$ be a regular local ring of dimension $d \geq 1$, $I$ an $\mathfrak{m}$-primary ideal. Let $N$ be a non-zero finitely generated $A$-module. Consider the functions \[ t^I(N, n) = \sum_{i = 0}^{ d}\ell(\text{Tor}^A_i(N, A/I^n)) \ \text{and}\ e^I(N, n) = \sum_{i = 0}^{ d}\ell(\text{Ext}_A^i(N, A/I^n)) \] of polynomial type and let their degrees be $t^I(N) $ and $e^I(N)$. We prove that $t^I(N) = e^I(N) = \max\{ \dim N, d -1 \}$.


title: PG-LBO: Enhancing High-Dimensional Bayesian Optimization with Pseudo-Label and Gaussian Process Guidance

abstract: Variational Autoencoder based Bayesian Optimization (VAE-BO) has demonstrated its excellent performance in addressing high-dimensional structured optimization problems. However, current mainstream methods overlook the potential of utilizing a pool of unlabeled data to construct the latent space, while only concentrating on designing sophisticated models to leverage the labeled data. Despite their effective usage of labeled data, these methods often require extra network structures, additional procedure, resulting in computational inefficiency. To address this issue, we propose a novel method to effectively utilize unlabeled data with the guidance of labeled data. Specifically, we tailor the pseudo-labeling technique from semi-supervised learning to explicitly reveal the relative magnitudes of optimization objective values hidden within the unlabeled data. Based on this technique, we assign appropriate training weights to unlabeled data to enhance the construction of a discriminative latent space. Furthermore, we treat the VAE encoder and the Gaussian Process (GP) in Bayesian optimization as a unified deep kernel learning process, allowing the direct utilization of labeled data, which we term as Gaussian Process guidance. This directly and effectively integrates the goal of improving GP accuracy into the VAE training, thereby guiding the construction of the latent space. The extensive experiments demonstrate that our proposed method outperforms existing VAE-BO algorithms in various optimization scenarios. Our code will be published at https://github.com/TaicaiChen/PG-LBO.


title: Reformulation and generalisation of the air-gap element

abstract: The air-gap macro element is reformulated such that rotation, rotor or stator skewing and rotor eccentricity can be incorporated easily. The air-gap element is evaluated using Fast Fourier Transforms which in combination with the Conjugate Gradient algorithm leads to highly efficient and memory inexpensive iterative solution scheme. The improved air-gap element features beneficial approximation properties and is competitive to moving-band and sliding-surface technique.


title: Model-aware reinforcement learning for high-performance Bayesian experimental design in quantum metrology

abstract: Quantum sensors offer control flexibility during estimation by allowing manipulation by the experimenter across various parameters. For each sensing platform, pinpointing the optimal controls to enhance the sensor's precision remains a challenging task. While an analytical solution might be out of reach, machine learning offers a promising avenue for many systems of interest, especially given the capabilities of contemporary hardware. We have introduced a versatile procedure capable of optimizing a wide range of problems in quantum metrology, estimation, and hypothesis testing by combining model-aware reinforcement learning (RL) with Bayesian estimation based on particle filtering. To achieve this, we had to address the challenge of incorporating the many non-differentiable steps of the estimation in the training process, such as measurements and the resampling of the particle filter. Model-aware RL is a gradient-based method, where the derivatives of the sensor's precision are obtained through automatic differentiation (AD) in the simulation of the experiment. Our approach is suitable for optimizing both non-adaptive and adaptive strategies, using neural networks or other agents. We provide an implementation of this technique in the form of a Python library called qsensoropt, alongside several pre-made applications for relevant physical platforms, namely NV centers, photonic circuits, and optical cavities. This library will be released soon on PyPI. Leveraging our method, we've achieved results for many examples that surpass the current state-of-the-art in experimental design. In addition to Bayesian estimation, leveraging model-aware RL, it is also possible to find optimal controls for the minimization of the Cram\'er-Rao bound, based on Fisher information.


title: Analysis of Kozai Cycles in Equal-Mass Hierarchical Triple Supermassive Black Hole Mergers in the Presence of a Stellar Cluster

abstract: Supermassive black holes (SMBHs) play an important role in galaxy evolution. Binary and triple SMBHs can form after galaxy mergers. A third SMBH may accelerate the SMBH merging process, possibly through the Kozai mechanism. We use N -body simulations to analyze oscillations in the orbital elements of hierarchical triple SMBHs with surrounding star clusters in galaxy centers. We find that SMBH triples spend only a small fraction of time in the hierarchical merger phase (i.e., a binary SMBH with a distant third SMBH perturber). Most of the time, the enclosed stellar mass within the orbits of the innermost or the outermost SMBH is comparable to the SMBH masses, indicating that the influence of the surrounding stellar population cannot be ignored. We search for Eccentric Kozai-Lidov (EKL) oscillations for which (i) the eccentricity of the inner binary and inclination are both oscillate and are anti-phase or in-phase and (ii) the oscillation period is consistent with EKL timescale. We find that EKL oscillations are short-lived and rare: the triple SMBH spends around 3% of its time in this phase over the ensemble of simulations, reaching around 8% in the best-case scenario. This suggests that the role of the EKL mechanism in accelerating the SMBH merger process may have been overestimated in previous studies. We follow-up with three-body simulations, using initial conditions extracted from the simulation, and the result can to some extent repeat the observed EKL-like oscillations. This comparison provides clues about why those EKL oscillations with perturbing stars are short-lived.


title: Image Quality, Uniformity and Computation Improvement of Compressive Light Field Displays with U-Net

abstract: We apply the U-Net model for compressive light field synthesis. Compared to methods based on stacked CNN and iterative algorithms, this method offers better image quality, uniformity and less computation.


title: Efficient decoupling of a non-linear qubit mode from its environment

abstract: To control and measure the state of a quantum system it must necessarily be coupled to external degrees of freedom. This inevitably leads to spontaneous emission via the Purcell effect, photon-induced dephasing from measurement back-action, and errors caused by unwanted interactions with nearby quantum systems. To tackle this fundamental challenge, we make use of the design flexibility of superconducting quantum circuits to form a multi-mode element -- an artificial molecule -- with symmetry-protected modes. The proposed circuit consists of three superconducting islands coupled to a central island via Josephson junctions. It exhibits two essential non-linear modes, one of which is flux-insensitive and used as the protected qubit mode. The second mode is flux-tunable and serves via a cross-Kerr type coupling as a mediator to control the dispersive coupling of the qubit mode to the readout resonator. We demonstrate the Purcell protection of the qubit mode by measuring relaxation times that are independent of the mediated dispersive coupling. We show that the coherence of the qubit is not limited by photon-induced dephasing when detuning the mediator mode from the readout resonator and thereby reducing the dispersive coupling. The resulting highly protected qubit with tunable interactions may serve as a basic building block of a scalable quantum processor architecture, in which qubit decoherence is strongly suppressed.


title: Vortex solitons in topological disclination lattices

abstract: The existence of thresholdless vortex solitons trapped at the core of disclination lattices that realize higher-order topological insulators is reported. The study demonstrates the interplay between nonlinearity and higher-order topology in these systems, as the vortex state in the disclination lattice bifurcates from its linear topological counterpart, while the position of its propagation constant within the bandgap and localization can be controlled by its power. It is shown that vortex solitons are characterized by strong field confinement at the disclination core due to their topological nature, leading to enhanced stability. Simultaneously, the global discrete rotational symmetry of the disclination lattice imposes restrictions on the maximal possible topological charge of such vortex solitons. The results illustrate the strong stabilizing action that topologically nontrivial structures may exert on excited soliton states, opening new prospects for soliton-related applications.


title: Spiralling branes and R-matrices

abstract: We extend the dictionary between Type IIB branes and representations of the Ding-Iohara-Miki (DIM) algebra to the case when one of the space directions is a circle. It is well-known that the worldvolume theory on branes wrapping the circle is a 5d $\mathcal{N}=1$ gauge theory with adjoint matter, or more generally of cyclic quiver type, and the corresponding intertwiners of the DIM algebra give their Nekrasov partition functions. However, we find that there exists a much wider natural class of intertwiners corresponding to branes spiralling around the compactified direction, with many interesting properties. We consider two examples, one corresponding to a spiralling D5 brane and another to a D3 brane. The former gives rise to the K-theoretic vertex function counting sheaves on $\mathbb{C}^3$ while the latter produces the "non-stationary elliptic Ruijsenaars wavefunctions" introduced recently by Shiraishi.


title: Extracting Error Thresholds through the Framework of Approximate Quantum Error Correction Condition

abstract: The robustness of quantum memory against physical noises is measured by two methods: the exact and approximate quantum error correction (QEC) conditions for error recoverability, and the decoder-dependent error threshold which assesses if the logical error rate diminishes with system size. Here we unravel their relations and propose a unified framework to extract an intrinsic error threshold from the approximate QEC condition, which could upper bound other decoder-dependent error thresholds. Our proof establishes that relative entropy, effectively measuring deviations from exact QEC conditions, serves as the order parameter delineating the transition from asymptotic recoverability to unrecoverability. Consequently, we establish a unified framework for determining the error threshold across both exact and approximate QEC codes, addressing errors originating from noise channels as well as those from code space imperfections. This result sharpens our comprehension of error thresholds across diverse QEC codes and error models.

categories: quant-ph cond-mat.stat-mech math-ph math.MP


title: Non-split sharply 2-transitive groups of odd positive characteristic

abstract: It is well-known that every sharply 2-transitive group of characteristic 3 splits. Here we construct the first examples of non-split sharply 2-transitive groups in odd positive characteristic $p$, for sufficiently large primes $p$. Furthermore, we show that any group without 2-torsion can be embedded into a non-split sharply 2-transitive group of characteristic $p$ for all sufficiently large primes $p$, yielding $2^{\aleph_0}$ many pairwise non-isomorphic countable non-split sharply 2-transitive groups in any sufficiently large characteristic.


title: Present status and future prospects of neutrino oscillation experiments

abstract: In this proceeding we discuss the status of the currently running experiments and the capability of the future proposed experiments to study neutrino oscillation. In particular, we discuss the current results of the accelerator-based long-baseline experiments in the standard three-flavour scenario and for a scenario where one assumes the existence of a light sterile neutrino at the eV scale in addition to the three active neutrinos. Further, we also discuss the capability of the future long-baseline experiments to study these scenarios.


title: 3D observations discover a new paradigm in rubber elasticity

abstract: The mechanical response of rubbers has been ubiquitously assumed to be only a function of the imposed strain. Using innovative X-ray measurements capturing the three-dimensional spatial volumetric strain fields, we demonstrate that rubbers and indeed many common engineering polymers, undergo significant local volume changes. But remarkably the overall specimen volume remains constant regardless of the imposed loading. This strange behaviour which also leads to apparent negative local bulk moduli is due to the presence of a mobile phase within these materials. Combining X-ray tomographic observations with high-speed radiography to track the motion of the mobile phase we have revised classical thermodynamic frameworks of rubber elasticity. The work opens new avenues to understand not only the mechanical behaviour of rubbers but a large class of widely used engineering polymers.


title: FlowDA: Unsupervised Domain Adaptive Framework for Optical Flow Estimation

abstract: Collecting real-world optical flow datasets is a formidable challenge due to the high cost of labeling. A shortage of datasets significantly constrains the real-world performance of optical flow models. Building virtual datasets that resemble real scenarios offers a potential solution for performance enhancement, yet a domain gap separates virtual and real datasets. This paper introduces FlowDA, an unsupervised domain adaptive (UDA) framework for optical flow estimation. FlowDA employs a UDA architecture based on mean-teacher and integrates concepts and techniques in unsupervised optical flow estimation. Furthermore, an Adaptive Curriculum Weighting (ACW) module based on curriculum learning is proposed to enhance the training effectiveness. Experimental outcomes demonstrate that our FlowDA outperforms state-of-the-art unsupervised optical flow estimation method SMURF by 21.6%, real optical flow dataset generation method MPI-Flow by 27.8%, and optical flow estimation adaptive method FlowSupervisor by 30.9%, offering novel insights for enhancing the performance of optical flow estimation in real-world scenarios. The code will be open-sourced after the publication of this paper.


title: Mitigating Modal Noise in Multimode Circular Fibres by Optical Agitation using a Galvanometer

abstract: Modal noise appears due to the non-uniform and unstable distribution of light intensity among the finite number of modes in multimode fibres. It is an important limiting factor in measuring radial velocity precisely by fibre-fed high-resolution spectrographs. The problem can become particularly severe as the fibre's core become smaller and the number of modes that can propagate reduces. Thus, mitigating modal noise in relatively small core fibres still remains a challenge. We present here a novel technique to suppress modal noise. Two movable mirrors in the form of a galvanometer reimage the mode-pattern of an input fibre to an output fibre. The mixing of modes coupled to the output fibre can be controlled by the movement of mirrors applying two sinusoidal signals through a voltage generator. We test the technique for four multimode circular fibres: 10 and 50 micron step-index, 50 micron graded-index, and a combination of 50 micron graded-index and 5:1 tapered fibres (GI50t). We present the results of mode suppression both in terms of the direct image of the output fibre and spectrum of white light obtained with the high-resolution spectrograph. We found that the galvanometer mitigated modal noise in all the tested fibres, but was most useful for smaller core fibres. However, there is a trade-off between the modal noise reduction and light-loss. The GI50t provides the best result with about 60% mitigation of modal noise at a cost of about 5% output light-loss. Our solution is easy to use and can be implemented in fibre-fed spectrographs.


title: Subsampling MCMC for Bayesian Variable Selection and Model Averaging in BGNLM

abstract: Bayesian Generalized Nonlinear Models (BGNLM) offer a flexible nonlinear alternative to GLM while still providing better interpretability than machine learning techniques such as neural networks. In BGNLM, the methods of Bayesian Variable Selection and Model Averaging are applied in an extended GLM setting. Models are fitted to data using MCMC within a genetic framework by an algorithm called GMJMCMC. In this paper, we combine GMJMCMC with a novel algorithm called S-IRLS-SGD for estimating the marginal likelihoods in BGLM/BGNLM by subsampling from the data. This allows to apply GMJMCMC to tall data.


title: Deep Unfolding Network with Spatial Alignment for multi-modal MRI reconstruction

abstract: Multi-modal Magnetic Resonance Imaging (MRI) offers complementary diagnostic information, but some modalities are limited by the long scanning time. To accelerate the whole acquisition process, MRI reconstruction of one modality from highly undersampled k-space data with another fully-sampled reference modality is an efficient solution. However, the misalignment between modalities, which is common in clinic practice, can negatively affect reconstruction quality. Existing deep learning-based methods that account for inter-modality misalignment perform better, but still share two main common limitations: (1) The spatial alignment task is not adaptively integrated with the reconstruction process, resulting in insufficient complementarity between the two tasks; (2) the entire framework has weak interpretability. In this paper, we construct a novel Deep Unfolding Network with Spatial Alignment, termed DUN-SA, to appropriately embed the spatial alignment task into the reconstruction process. Concretely, we derive a novel joint alignment-reconstruction model with a specially designed cross-modal spatial alignment term. By relaxing the model into cross-modal spatial alignment and multi-modal reconstruction tasks, we propose an effective algorithm to solve this model alternatively. Then, we unfold the iterative steps of the proposed algorithm and design corresponding network modules to build DUN-SA with interpretability. Through end-to-end training, we effectively compensate for spatial misalignment using only reconstruction loss, and utilize the progressively aligned reference modality to provide inter-modality prior to improve the reconstruction of the target modality. Comprehensive experiments on three real datasets demonstrate that our method exhibits superior reconstruction performance compared to state-of-the-art methods.


title: Multi-Tier Computing-Enabled Digital Twin in 6G Networks

abstract: Digital twin (DT) is the recurrent and common feature in discussions about future technologies, bringing together advanced communication, computation, and artificial intelligence, to name a few. In the context of Industry 4.0, industries such as manufacturing, automotive, and healthcare are rapidly adopting DT-based development. The main challenges to date have been the high demands on communication and computing resources, as well as privacy and security concerns, arising from the large volumes of data exchanges. To achieve low latency and high security services in the emerging DT, multi-tier computing has been proposed by combining edge/fog computing and cloud computing. Specifically, low latency data transmission, efficient resource allocation, and validated security strategies of multi-tier computing systems are used to solve the operational problems of the DT system. In this paper, we introduce the architecture and applications of DT using examples from manufacturing, the Internet-of-Vehicles and healthcare. At the same time, the architecture and technology of multi-tier computing systems are studied to support DT. This paper will provide valuable reference and guidance for the theory, algorithms, and applications in collaborative multi-tier computing and DT.


title: Invariant Differential Operators for Non-Compact Lie Groups: the $Sp(n,1)$ Case

abstract: In the present paper we continue the project of systematic construction of invariant differential operators on the example of the non-compact algebras $sp(n,1)$. Our choice of these algebras is motivated by the fact that they belong to a narrow class of algebras, which are of split rank one, of which class the other cases were studied, some long time ago. We concentrate on the case $n=2$. We give the main multiplets and the main reduced multiplets of indecomposable elementary representations for, including the necessary data for all relevant invariant differential operators. We also present explicit expressions for the singular vectors and for the intertwining differential operators.


title: Natural sinks and sources of CO2 and CH4 in the atmosphere of Russian regions and their contribution to climate change in the 21st century as calculated with CMIP6 model ensemble

abstract: The natural fluxes of CO2 and CH4 into the atmosphere from the territory of Russia in the 21st century have been analyzed using the results of calculations with the ensemble of global climate models of the international project CMIP6. Estimates of natural CO2 fluxes for Russian regions differ greatly for different models. Their values for the beginning of the 21st century range from -1 to 1 GtC/yr. In the 21st century the differences in model estimates of fluxes grow and at the end of the 21st century under the scenario with the largest anthropogenic impacts SSP5-8.5 are in the range from -2.5 to 2.5 GtC/year. Estimates of natural methane emissions to the atmosphere from the territory of Russia also differ greatly for different models. Present-day methane emissions are estimated in the range from 10 to 35 MtCH4/year, while the growth in the 21st century may reach 300%. Ensemble model calculations show general trends for changes in natural greenhouse gas fluxes. Most CMIP6 ensemble models are characterized by a maximum of CO2 uptake by terrestrial ecosystems and its further reduction by the end of the 21st century, while natural methane emissions to the atmosphere for all models and scenarios of anthropogenic forcing grow throughout the 21st century. The cumulative temperature potential of natural CO2 fluxes on the territory of Russia in the 21st century is estimated, depending on the scenario of anthropogenic impacts, from -0.3 to 0.1 K, and the warming-accelerating impact of natural CH4 emissions is estimated in the range of 0.03-0.09 K.


title: Advances in the kinetics of heat and mass transfer in near-continuous complex flows

abstract: The study of macro continuous flow has a long history. Simultaneously, the exploration of heat and mass transfer in small systems with a particle number of several hundred or less has gained significant interest in the fields of statistical physics and nonlinear science. However, due to absence of suitable methods, the understanding of mesoscale behavior situated between the aforementioned two scenarios, which challenges the physical function of traditional continuous fluid theory and exceeds the simulation capability of microscopic molecular dynamics method, remains considerably deficient. This greatly restricts the evaluation of effects of mesoscale behavior and impedes the development of corresponding regulation techniques. To access the mesoscale behaviors, there are two ways: from large to small and from small to large. Given the necessity to interface with the prevailing macroscopic continuous modeling currently used in the mechanical engineering community, our study of mesoscale behavior begins from the side closer to the macroscopic continuum, that is from large to small. Focusing on some fundamental challenges encountered in modeling and analysis of near-continuous flows, we review the research progress of discrete Boltzmann method (DBM). The ideas and schemes of DBM in coarse-grained modeling and complex physical field analysis are introduced. The relationships, particularly the differences, between DBM and traditional fluid modeling as well as other kinetic methods are discussed. After verification and validation of the method, some applied researches including the development of various physical functions associated with discrete and non-equilibrium effects are illustrated. Future directions of DBM related studies are indicated.


title: Battery model impact on time-optimal co-design for electric racing cars: review and application

abstract: The sustainable mobility trend touches the racing world as well, from the hybridization of Formula 1 (F1) and Le Mans Hypercars to the fully electric Formula E racing class. In this scenario, the research community is studying how to push electric racing vehicles to their limit, combining vehicle dynamics and energy management, to successfully solve the minimum lap time problem. Recently, this class of problems has been enlarged towards optimal sizing, with a particular interest in batteries, which represent the main bottleneck for electric vehicle performance. In this work, starting from a thorough review of literature approaches, we define a general optimization framework of minimum lap and race time problems for electric vehicles, suitable to figure out the impact of different modeling choices on both problem structure and optimal variables profiles. Exploiting a case study on Generation 3 (Gen 3) of Formula E cars, we delve into the impact of battery models' complexity on both optimal sizing and optimal battery usage. We show how highly detailed models are necessary to study the evolution of both battery and vehicle control variables during the race, while, simple models are more than sufficient to address the battery sizing problem.


title: Continual Learning in Medical Image Analysis: A Comprehensive Review of Recent Advancements and Future Prospects

abstract: Medical imaging analysis has witnessed remarkable advancements even surpassing human-level performance in recent years, driven by the rapid development of advanced deep-learning algorithms. However, when the inference dataset slightly differs from what the model has seen during one-time training, the model performance is greatly compromised. The situation requires restarting the training process using both the old and the new data which is computationally costly, does not align with the human learning process, and imposes storage constraints and privacy concerns. Alternatively, continual learning has emerged as a crucial approach for developing unified and sustainable deep models to deal with new classes, tasks, and the drifting nature of data in non-stationary environments for various application areas. Continual learning techniques enable models to adapt and accumulate knowledge over time, which is essential for maintaining performance on evolving datasets and novel tasks. This systematic review paper provides a comprehensive overview of the state-of-the-art in continual learning techniques applied to medical imaging analysis. We present an extensive survey of existing research, covering topics including catastrophic forgetting, data drifts, stability, and plasticity requirements. Further, an in-depth discussion of key components of a continual learning framework such as continual learning scenarios, techniques, evaluation schemes, and metrics is provided. Continual learning techniques encompass various categories, including rehearsal, regularization, architectural, and hybrid strategies. We assess the popularity and applicability of continual learning categories in various medical sub-fields like radiology and histopathology...


title: Fourier-transform spectroscopy and global deperturbation treatment of the $A^1\Sigma^+_u$ and $b^3\Pi_u$ states of K$_2$ in the entire bound energy range

abstract: Rotationally-resolved Fourier-transform spectra of laser-induced fluorescence (LIF) $A^1\Sigma^+_u\sim b^3\Pi_u \rightarrow X^1\Sigma^+_g$ of K$_2$ molecules were recorded and analyzed yielding 4053 term values of spin-orbit (SO) coupled $A \sim b$ complex of $^{39}$K$_2$ isotopologue with ca 0.01 cm$^{-1}$ accuracy. Their compilation with 1739 term values from previously published sources allowed to cover the energy range [9955, 17436] cm$^{-1}$ from the bottom of the lower-lying $b^3\Pi_u$ state up to the vicinity of the atomic asymptote $4s\;^2{\rm S}_{1/2}$ + $4p\;^2{\rm P}_{1/2}$, with rotational quantum number $J\in[0,149]$. The experimental data were processed by a direct 6$\times$6 coupled-channel (CC) deperturbation treatment, which accounted explicitly for both SO and electronic-rotational interactions between six states: $A^1\Sigma^+_u$($0$), $b^3\Pi_u$(0,1,2), $c^3\Sigma_u$(1), and $B^1\Pi_u$(1). The initial parameters of the global deperturbation model have been estimated in the framework of {\it ab initio} electronic structure calculations applying multi-referenced configuration-interaction and coupled-clusters methods. The interatomic potentials analytically defined for $A$ and $b$ states, as well as SO-splitting of the triplet $b$ state and $A\sim b$ SO-coupling functions have been refined to fit 5792 term values of the $^{39}$K$_2$ isotopologue, whereas the rest parameters were fixed on their {\it ab initio} values. The resulting mass-invariant parameters of the CC model reproduced the overall rovibronic term energies of the $A \sim b$ complex of $^{39}$K$_2$ with the accuracy, which is well within the experimental errors. This deperturbation analysis provided the refined dissociation energy $T_{dis}$=17474.569(5) cm$^{-1}$ and the long-range coefficient $C_3^{\Sigma}$ = 5.501(4) $\times10^5$cm$^{-1}$ A$^3$ relevant to the non-relativistic atomic limit $4s$+$4p$.


title: Symbolic Models for Interconnected Impulsive Systems

abstract: In this paper, we present a compositional methodology for constructing symbolic models of nonlinear interconnected impulsive systems. Our approach relies on the concept of "alternating simulation function" to establish a relationship between concrete subsystems and their symbolic models. Assuming some small-gain type conditions, we develop an alternating simulation function between the symbolic models of individual subsystems and those of the nonlinear interconnected impulsive systems. To construct symbolic models of nonlinear impulsive subsystems, we propose an approach that depends on incremental input-to-state stability and forward completeness properties. Finally, we demonstrate the advantages of our framework through a case study.


title: On the rate of convergence of an over-parametrized Transformer classifier learned by gradient descent

abstract: One of the most recent and fascinating breakthroughs in artificial intelligence is ChatGPT, a chatbot which can simulate human conversation. ChatGPT is an instance of GPT4, which is a language model based on generative gredictive gransformers. So if one wants to study from a theoretical point of view, how powerful such artificial intelligence can be, one approach is to consider transformer networks and to study which problems one can solve with these networks theoretically. Here it is not only important what kind of models these network can approximate, or how they can generalize their knowledge learned by choosing the best possible approximation to a concrete data set, but also how well optimization of such transformer network based on concrete data set works. In this article we consider all these three different aspects simultaneously and show a theoretical upper bound on the missclassification probability of a transformer network fitted to the observed data. For simplicity we focus in this context on transformer encoder networks which can be applied to define an estimate in the context of a classification problem involving natural language.


title: Thermodynamic formalism and anomalous transport in 1D semiclassical Bose-Hubbard chain

abstract: We analyze the time-dependent free energy functionals of the semiclassical one-dimensional Bose-Hubbard chain. We first review the weakly chaotic dynamics and the consequent early-time anomalous diffusion in the system. The anomalous diffusion is robust, appears with strictly quantized coefficients, and persists even for very long chains (more than hundred sites), crossing over to normal diffusion at late times. We identify fast (angle) and slow (action) variables and thus consider annealed and quenched partition functions, corresponding to fixing the actions and integrating over the actions, respectively. We observe the leading quantum effects in the annealed free energy, whereas the quenched energy is undefined in the thermodynamic limit, signaling the absence of thermodynamic equilibrium in the quenched regime. But already the leading correction away from the quenched regime reproduces the annealed partition function exactly. This encapsulates the fact that in both slow- and fast-chaos regime both the anomalous and the normal diffusion can be seen (though at different times).

categories: quant-ph cond-mat.quant-gas cond-mat.stat-mech nlin.CD


title: Continued fractions for $q$-deformed real numbers, $\{-1,0,1\}$-Hankel determinants, and Somos-Gale-Robinson sequences

abstract: $q$-deformed real numbers are power series with integer coefficients. We study Stieltjes and Jacobi type continued fraction expansions of $q$-deformed real numbers and find many new examples of such continued fractions. We also investigate the corresponding sequences of Hankel determinants and find an infinite family of power series for which several of the first sequences of Hankel determinants consist of $-1,0$ and $1$ only. These Hankel sequences satisfy Somos and Gale-Robinson recurrences.


title: Robust Multi-Modal Image Stitching for Improved Scene Understanding

abstract: Multi-modal image stitching can be a difficult feat. That's why, in this paper, we've devised a unique and comprehensive image-stitching pipeline that taps into OpenCV's stitching module. Our approach integrates feature-based matching, transformation estimation, and blending techniques to bring about panoramic views that are of top-tier quality - irrespective of lighting, scale or orientation differences between images. We've put our pipeline to the test with a varied dataset and found that it's very effective in enhancing scene understanding and finding real-world applications.


title: Source-independent quantum random number generators with integrated silicon photonics

abstract: Random numbers play a crucial role in numerous scientific applications. Source-independent quantum random number generators (SI-QRNGs) can offer true randomness by leveraging the fundamental principles of quantum mechanics, eliminating the need for a trusted source. Silicon photonics shows great promise for QRNG due to its benefits in miniaturization, cost-effective device manufacturing, and compatibility with CMOS microelectronics. In this study, we experimentally demonstrate a silicon-based discrete variable SI-QRNG. Using a well-calibrated chip and an optimized parameter strategy, we achieve a record-breaking random number generation rate of 7.9 Mbits/s. Our research paves the way for integrated SI-QRNGs.


title: A Generalization of the Sugeno integral to aggregate Interval-valued data: an application to Brain Computer Interface and Social Network Analysis

abstract: Intervals are a popular way to represent the uncertainty related to data, in which we express the vagueness of each observation as the width of the interval. However, when using intervals for this purpose, we need to use the appropriate set of mathematical tools to work with. This can be problematic due to the scarcity and complexity of interval-valued functions in comparison with the numerical ones. In this work, we propose to extend a generalization of the Sugeno integral to work with interval-valued data. Then, we use this integral to aggregate interval-valued data in two different settings: first, we study the use of intervals in a brain-computer interface; secondly, we study how to construct interval-valued relationships in a social network, and how to aggregate their information. Our results show that interval-valued data can effectively model some of the uncertainty and coalitions of the data in both cases. For the case of brain-computer interface, we found that our results surpassed the results of other interval-valued functions.


title: Perspectives of Global and Hong Kong's Media on China's Belt and Road Initiative

abstract: This study delves into the media analysis of China's ambitious Belt and Road Initiative (BRI), which, in a polarized world, and furthermore, owing to the very polarizing nature of the initiative itself, has received both strong criticisms and conversely positive coverage in media from across the world. In that context, Hong Kong's dynamic media environment, with a particular focus on its drastically changing press freedom before and after the implementation of the National Security Law is of further interest. Leveraging data science techniques, this study employs Global Database of Events, Language, and Tone (GDELT) to comprehensively collect and analyse (English) news articles on the BRI. Through sentiment analysis, we uncover patterns in media coverage over different periods from several countries across the globe, and delve further to investigate the the media situation in the Hong Kong region. This work thus provides valuable insights into how the Belt and Road Initiative has been portrayed in the media and its evolving reception on the global stage, with a specific emphasis on the unique media landscape of Hong Kong. In an era characterised by increasing globalisation and inter-connectivity, but also competition for influence, animosity and trade-wars, understanding the perceptions and coverage of such significant international projects is crucial. This work stands as an interdisciplinary endeavour merging geopolitical science and data science to uncover the intricate dynamics of media coverage in general, and with an added emphasis on Hong Kong.


title: Universality on thermodynamic relation with corrections in de Sitter black holes

abstract: We herein investigate the universal relation proposed by Goon and Penco in de Sitter black holes with electric charge or angular momentum. Our analysis focuses on the cosmological horizon, which only exists in de Sitter and Nariai spacetimes. Because the relation is given in a general case, the overall relationship may be valid. However, we elucidate the details of the relation, highlighting distinctions from those of (anti-)de Sitter black holes while affirming the validity of the relation. Furthermore, based on our analysis of Schwarzschild--de Sitter, Reissner--Nordstr\"om--de Sitter, and Kerr--de Sitter black holes, we demonstrate the universality of the thermodynamic relation in de Sitter black holes.


title: Regularized Exponentially Tilted Empirical Likelihood for Bayesian Inference

abstract: Bayesian inference with empirical likelihood faces a challenge as the posterior domain is a proper subset of the original parameter space due to the convex hull constraint. We propose a regularized exponentially tilted empirical likelihood to address this issue. Our method removes the convex hull constraint using a novel regularization technique, incorporating a continuous exponential family distribution to satisfy a Kullback-Leibler divergence criterion. The regularization arises as a limiting procedure where pseudo-data are added to the formulation of exponentially tilted empirical likelihood in a structured fashion. We show that this regularized exponentially tilted empirical likelihood retains certain desirable asymptotic properties of (exponentially tilted) empirical likelihood and has improved finite sample performance. Simulation and data analysis demonstrate that the proposed method provides a suitable pseudo-likelihood for Bayesian inference. The implementation of our method is available as the R package retel. Supplementary materials for this article are available online.


title: On the Promises and Challenges of Multimodal Foundation Models for Geographical, Environmental, Agricultural, and Urban Planning Applications

abstract: The advent of large language models (LLMs) has heightened interest in their potential for multimodal applications that integrate language and vision. This paper explores the capabilities of GPT-4V in the realms of geography, environmental science, agriculture, and urban planning by evaluating its performance across a variety of tasks. Data sources comprise satellite imagery, aerial photos, ground-level images, field images, and public datasets. The model is evaluated on a series of tasks including geo-localization, textual data extraction from maps, remote sensing image classification, visual question answering, crop type identification, disease/pest/weed recognition, chicken behavior analysis, agricultural object counting, urban planning knowledge question answering, and plan generation. The results indicate the potential of GPT-4V in geo-localization, land cover classification, visual question answering, and basic image understanding. However, there are limitations in several tasks requiring fine-grained recognition and precise counting. While zero-shot learning shows promise, performance varies across problem domains and image complexities. The work provides novel insights into GPT-4V's capabilities and limitations for real-world geospatial, environmental, agricultural, and urban planning challenges. Further research should focus on augmenting the model's knowledge and reasoning for specialized domains through expanded training. Overall, the analysis demonstrates foundational multimodal intelligence, highlighting the potential of multimodal foundation models (FMs) to advance interdisciplinary applications at the nexus of computer vision and language.


title: Mass spectrum of spin-one hadrons in dense two-color QCD: Novel predictions by extended linear sigma model

abstract: We construct an extended version of the linear sigma model in such a way as to describe spin-$1$ hadrons as well as spin-$0$ hadrons in two-color QCD (QC$_2$D) by respecting the Pauli-G\"{u}rsey $SU(4)$ symmetry. Within a mean-field approximation, we therefrom examine a mass spectrum of the spin-$1$ hadrons at finite quark chemical potential ($\mu_q$) and zero temperature. Not only mean fields of scalar mesons and scalar-diquark baryons but also of vector mesons and vector-diquark baryons are incorporated. As a result, we find that, unless all of those four types of mean fields are taken into account, neither lattice result for the critical $\mu_q$ that corresponds to the onset of baryon superfluidity nor for $\mu_q$ dependence of the pion mass can be reproduced. We also find that a slight suppression of the $\rho$ meson mass in the superfluid phase, which was suggested by the lattice simulation, is reproduced by subtle mixing effects between spin-$0$ and spin-$1$ hadrons. Moreover, we demonstrate the emergence of an axialvector condensed phase and possibly of a vector condensed phase by identifying the values of $\mu_q$ at which the corresponding hadron masses vanish. The possible presence of iso-triplet $1^-$ diquarks that may be denoted by a tensor-type quark bilinear field is also discussed.


title: Learning Spatially Collaged Fourier Bases for Implicit Neural Representation

abstract: Existing approaches to Implicit Neural Representation (INR) can be interpreted as a global scene representation via a linear combination of Fourier bases of different frequencies. However, such universal basis functions can limit the representation capability in local regions where a specific component is unnecessary, resulting in unpleasant artifacts. To this end, we introduce a learnable spatial mask that effectively dispatches distinct Fourier bases into respective regions. This translates into collaging Fourier patches, thus enabling an accurate representation of complex signals. Comprehensive experiments demonstrate the superior reconstruction quality of the proposed approach over existing baselines across various INR tasks, including image fitting, video representation, and 3D shape representation. Our method outperforms all other baselines, improving the image fitting PSNR by over 3dB and 3D reconstruction to 98.81 IoU and 0.0011 Chamfer Distance.


title: Efficient Learning of Long-Range and Equivariant Quantum Systems

abstract: In this work, we consider a fundamental task in quantum many-body physics - finding and learning ground states of quantum Hamiltonians and their properties. Recent works have studied the task of predicting the ground state expectation value of sums of geometrically local observables by learning from data. For short-range gapped Hamiltonians, a sample complexity that is logarithmic in the number of qubits and quasipolynomial in the error was obtained. Here we extend these results beyond the local requirements on both Hamiltonians and observables, motivated by the relevance of long-range interactions in molecular and atomic systems. For interactions decaying as a power law with exponent greater than twice the dimension of the system, we recover the same efficient logarithmic scaling with respect to the number of qubits, but the dependence on the error worsens to exponential. Further, we show that learning algorithms equivariant under the automorphism group of the interaction hypergraph achieve a sample complexity reduction, leading in particular to a constant number of samples for learning sums of local observables in systems with periodic boundary conditions. We demonstrate the efficient scaling in practice by learning from DMRG simulations of $1$D long-range and disordered systems with up to $128$ qubits. Finally, we provide an analysis of the concentration of expectation values of global observables stemming from the central limit theorem, resulting in increased prediction accuracy.


title: Expansion of the Universe

abstract: I review the use of Type Ia supernovae (SNe Ia) in the 1998 discovery of the accelerating expansion of the Universe, as well as the subsequent use of SNe Ia to study the expansion history in more detail, determine the equation-of-state parameter w, and measure the current value of the Hubble constant. This is the lightly edited transcript of a lecture given at the Standard Model at 50 Symposium held at Case Western University, June 1-4, 2018, and thus corresponds to the state of the field in mid-2018; however, a few post-symposium updates were included in 2019. Also, this version includes at the end a brief update (December 2023) on the early-time vs. late-time Hubble tension, which has now reached a level of 5 sigma based on SNe Ia alone and is supported by several other low-redshift determinations of the Hubble constant.


title: Predual Spaces of Hardy Spaces Related to Fractional Schr\"odinger Operators

abstract: Let $n\in\mathbb{N}$ and ${\alpha}\in(0,\min\{2,n\})$. For any $a\in[a^\ast,\infty)$, the fractional Schr\"odinger operator $L_\alpha$ is defined by \begin{equation*} L_\alpha:=(-\Delta)^{{\alpha}/2}+a{|x|}^{-{\alpha}}, \end{equation*} where $a^*:=-{\frac{2^{\alpha}{\Gamma}((d+{\alpha})/4)^2}{{\Gamma}((d-{\alpha})/4)^2}}$. Let $\gamma\in[0,\frac{\alpha}{n})$. In this paper, we introduce the VMO-type spaces $\mathrm{VMO}_{L_\alpha}^\gamma (\mathbb{R}^{n})$ associated with $L_\alpha$, and characterize these spaces via some tent spaces. We also prove that, for any given $p\in(\frac{n}{n+\alpha},1]$, the space $\mathrm{VMO}_{L_\alpha}^{\frac{1}{p}-1} (\mathbb{R}^{n})$ is the predual space of the Hardy space $H_{L_\alpha}^p\left(\mathbb{R}^{n}\right)$ related to $L_\alpha$.


title: A refinement of Kelly's lemma for graph reconstruction for counting rooted subgraphs

abstract: Kelly's lemma is a basic result on graph reconstruction. It states that given the deck of a graph $G$ on $n$ vertices, and a graph $F$ on fewer than $n$ vertices, we can count the number of subgraphs of $G$ that are isomorphic to $F$. Moreover, for a given card $G-v$ in the deck, we can count the number of subgraphs of $G$ that are isomorphic to $F$ and that contain $v$. We consider the problem of refining the lemma to count rooted subgraphs such that the root vertex coincides the deleted vertex. We show that such counting is not possible in general, but a multiset of rooted subgraphs of a fixed height $k$ can be counted if $G$ has radius more than $k$. We also prove a similar result for the edge reconstruction problem.


title: Tensorial structure of the lifting doctrine in constructive domain theory

abstract: We present a survey of the two-dimensional and tensorial structure of the lifting doctrine in constructive domain theory, i.e. in the theory of directed-complete partial orders (dcpos) over an arbitrary elementary topos. We establish the universal property of lifting of dcpos as the Sierpi\'nski cone, from which we deduce (1) that lifting forms a Kock-Z\"oberlein doctrine, (2) that lifting algebras, pointed dcpos, and inductive partial orders form canonically equivalent locally posetal 2-categories, and (3) that the category of lifting algebras is cocomplete, with connected colimits created by the forgetful functor to dcpos. Finally we deduce the symmetric monoidal closure of the Eilenberg-Moore resolution of the lifting 2-monad by means of smash products; these are shown to classify both bilinear maps and strict maps, which we prove to coincide in the constructive setting. We provide several concrete computations of the smash product as dcpo coequalisers and lifting algebra coequalisers, and compare these with the more abstract results of Seal. Although all these results are well-known classically, the existing proofs do not apply in a constructive setting; indeed, the classical analysis of the Eilenberg-Moore category of the lifting monad relies on the fact that all lifting algebras are free, a condition that is not known to hold constructively.


title: Selective Run-Length Encoding

abstract: Run-Length Encoding (RLE) is one of the most fundamental tools in data compression. However, its compression power drops significantly if there lacks consecutive elements in the sequence. In extreme cases, the output of the encoder may require more space than the input (aka size inflation). To alleviate this issue, using combinatorics, we quantify RLE's space savings for a given input distribution. With this insight, we develop the first algorithm that automatically identifies suitable symbols, then selectively encodes these symbols with RLE while directly storing the others without RLE. Through experiments on real-world datasets of various modalities, we empirically validate that our method, which maintains RLE's efficiency advantage, can effectively mitigate the size inflation dilemma.


title: Experiential Co-Learning of Software-Developing Agents

abstract: Recent advancements in large language models (LLMs) have brought significant changes to various domains, especially through LLM-driven autonomous agents. A representative scenario is in software development, where LLM agents demonstrate efficient collaboration, task division, and assurance of software quality, markedly reducing the need for manual involvement. However, these agents frequently perform a variety of tasks independently, without benefiting from past experiences, which leads to repeated mistakes and inefficient attempts in multi-step task execution. To this end, we introduce Experiential Co-Learning, a novel LLM-agent learning framework in which instructor and assistant agents gather shortcut-oriented experiences from their historical trajectories and use these past experiences for future task execution. The extensive experiments demonstrate that the framework enables agents to tackle unseen software-developing tasks more effectively. We anticipate that our insights will guide LLM agents towards enhanced autonomy and contribute to their evolutionary growth in cooperative learning. The code and data are available at https://github.com/OpenBMB/ChatDev.


title: On the class reconstruction number of trees

abstract: Harary and Lauri conjectured that the class reconstruction number of trees is 2, that is, each tree has two unlabelled vertex-deleted subtrees that are not both in the deck of any other tree. We show that each tree $T$ can be reconstructed up to isomorphism given two of its unlabelled subgraphs $T-u$ and $T-v$ under the assumption that $u$ and $v$ are chosen in a particular way. Our result does not completely resolve the conjecture of Harary and Lauri since the special property defining $u$ and $v$ cannot be recognised from the given subtrees $T-u$ and $T-v$.


title: 100-fold improvement in relaxed eddy accumulation flux estimates through error diffusion

abstract: Measurements of atmosphere-surface exchange are largely limited by the availability of fast-response gas analyzers; this limitation hampers our understanding of the role of terrestrial ecosystems in atmospheric chemistry and global change. Current micrometeorological methods, compatible with slow-response gas analyzers, are difficult to implement or rely on empirical parameters that introduce large systematic errors. Here, we develop a new micrometeorological method, optimized for slow-response gas analyzers, that directly measures exchange rates of different atmospheric constituents with minimal requirements. The new method requires only sampling air at a constant rate and directing it into one of two reservoirs, depending on the direction of the vertical wind velocity. An integral component of this technique is an error diffusion algorithm that minimizes the biases in the measured fluxes and achieves direct flux estimates. We demonstrate that the new method provides an unbiased estimate of the flux, with accuracy within 0.1% of the reference eddy covariance flux, and importantly, allows for significant enhancements in signal-to-noise ratio of measured scalars without compromising accuracy. Our new method provides a simple and reliable way to address complex environmental questions and offers a promising avenue for advancing our understanding of ecological systems and atmospheric chemistry.


title: Quantum Weyl-Heisenberg antiferromagnet

abstract: Beginning from the conventional square-lattice nearest-neighbor antiferromagnetic Heisenberg model, we allow the $J_x$ and $J_y$ couplings to be anisotropic, with their values depending on the bond orientation. The emergence of anisotropic, bond-dependent, couplings should be expected to occur naturally in most antiferromagnetic compounds which undergo structural transitions that reduce the point-group symmetry at lower temperature. Using the spin-wave approximation, we study the model in several parameter regimes by diagonalizing the reduced Hamiltonian exactly, and computing the edge spectrum and Berry connection vector, which show clear evidence of localized topological charges. We discover phases that exhibit Weyl-type spin-wave dispersion, characterized by pairs of degenerate points and edge states, as well as phases supporting lines of degeneracy. We also identify a parameter regime in which there is an exotic state hosting gapless linear spin-wave dispersions with different longitudinal and transverse spin-wave velocities. Author email info: prosenberg15@gmail.com and manousakis@gmail.com


title: FedSDD: Scalable and Diversity-enhanced Distillation for Model Aggregation in Federated Learning

abstract: Recently, innovative model aggregation methods based on knowledge distillation (KD) have been proposed for federated learning (FL). These methods not only improved the robustness of model aggregation over heterogeneous learning environment, but also allowed training heterogeneous models on client devices. However, the scalability of existing methods is not satisfactory, because the training cost on the server increases with the number of clients, which limits their application in large scale systems. Furthermore, the ensemble of existing methods is built from a set of client models initialized from the same checkpoint, causing low diversity. In this paper, we propose a scalable and diversity-enhanced federated distillation scheme, FedSDD, which decouples the training complexity from the number of clients to enhance the scalability, and builds the ensemble from a set of aggregated models with enhanced diversity. In particular, the teacher model in FedSDD is an ensemble built by a small group of aggregated (global) models, instead of all client models, such that the computation cost will not scale with the number of clients. Furthermore, to enhance diversity, FedSDD only performs KD to enhance one of the global models, i.e., the \textit{main global model}, which improves the performance of both the ensemble and the main global model. While partitioning client model into more groups allow building an ensemble with more aggregated models, the convergence of individual aggregated models will be slow down. We introduce the temporal ensembling which leverage the issues, and provide significant improvement with the heterogeneous settings. Experiment results show that FedSDD outperforms other FL methods, including FedAvg and FedDF, on the benchmark datasets.


title: Learning Multi-axis Representation in Frequency Domain for Medical Image Segmentation

abstract: Recently, Visual Transformer (ViT) has been extensively used in medical image segmentation (MIS) due to applying self-attention mechanism in the spatial domain to modeling global knowledge. However, many studies have focused on improving models in the spatial domain while neglecting the importance of frequency domain information. Therefore, we propose Multi-axis External Weights UNet (MEW-UNet) based on the U-shape architecture by replacing self-attention in ViT with our Multi-axis External Weights block. Specifically, our block performs a Fourier transform on the three axes of the input features and assigns the external weight in the frequency domain, which is generated by our External Weights Generator. Then, an inverse Fourier transform is performed to change the features back to the spatial domain. We evaluate our model on four datasets, including Synapse, ACDC, ISIC17 and ISIC18 datasets, and our approach demonstrates competitive performance, owing to its effective utilization of frequency domain information.


title: Generalized Mask-aware IoU for Anchor Assignment for Real-time Instance Segmentation

abstract: This paper introduces Generalized Mask-aware Intersection-over-Union (GmaIoU) as a new measure for positive-negative assignment of anchor boxes during training of instance segmentation methods. Unlike conventional IoU measure or its variants, which only consider the proximity of anchor and ground-truth boxes; GmaIoU additionally takes into account the segmentation mask. This enables GmaIoU to provide more accurate supervision during training. We demonstrate the effectiveness of GmaIoU by replacing IoU with our GmaIoU in ATSS, a state-of-the-art (SOTA) assigner. Then, we train YOLACT, a real-time instance segmentation method, using our GmaIoU-based ATSS assigner. The resulting YOLACT based on the GmaIoU assigner outperforms (i) ATSS with IoU by $\sim 1.0-1.5$ mask AP, (ii) YOLACT with a fixed IoU threshold assigner by $\sim 1.5-2$ mask AP over different image sizes and (iii) decreases the inference time by $25 \%$ owing to using less anchors. Taking advantage of this efficiency, we further devise GmaYOLACT, a faster and $+7$ mask AP points more accurate detector than YOLACT. Our best model achieves $38.7$ mask AP at $26$ fps on COCO test-dev establishing a new state-of-the-art for real-time instance segmentation.


title: The most symmetric smooth cubic surface over a finite field of characteristic $2$

abstract: In this paper we find the largest automorphism group of a smooth cubic surface over any finite field of characteristic $2.$ We prove that if the order of the field is a power of~$4,$ then the automorphism group of maximal order of~a~smooth cubic surface over this field is $\mathrm{PSU}_4(\mathbb{F}_2).$ If the order of the field of~characteristic~$2$ is not a power of $4,$ then we prove that the automorphism group of maximal order of a smooth cubic surface over this field is the symmetric group of degree $6.$ Moreover, we prove that smooth cubic surfaces with such properties are unique up to isomorphism.


title: Boolean TQFTs with accumulating defects, sofic systems, and automata for infinite words

abstract: Any finite state automaton gives rise to a Boolean one-dimensional TQFT with defects and inner endpoints of cobordisms. This paper extends the correspondence to Boolean TQFTs where defects accumulate toward inner endpoints, relating such TQFTs and topological theories to sofic systems and $\omega$-automata.

categories: math.CT cs.FL math-ph math.DS math.MP math.QA


title: Simulation of $e^+e^-$ annihilation with quark spin effects

abstract: The quark spin effects are introduced for the first time in the string fragmentation routine of the Pythia 8 Monte Carlo event generator for the simulation of $e^+e^-$ annihilation to hadrons. To describe the spin effects the string+${}^3P_0$ model of polarized hadronization with emissions of pseudoscalar and vector mesons is used. The spin effects are activated in the generator by extending the StringSpinner package, previously applied to the simulation of deep inelastic scattering off a polarized nucleon. The generator is used to carry out simulations of $e^+e^-$ annihilation at the center of mass energy of $10.6\,\rm{GeV}$. The Collins asymmetry for back-to-back pion pairs is evaluated and compared to the asymmetry as measured by the BELLE experiment. A satisfactory agreement is found.


title: On the perverse filtration of the moduli spaces of 1-dimensional sheaves on $\mathbb{P}^2$ and P=C conjecture

abstract: Let $M(d,\chi)$ be the moduli space of semistable 1-dimensional sheaves supported at curves of degree $d$ on $\mathbb{P}^2$, with Euler characteristic $\chi$. We have the Hilbert-Chow morphism $\pi: M(d,\chi)\rightarrow |dH|$ sending each sheaf to its support. We study the perverse filtration on $H^*(M(d,\chi),\mathbb{Q})$ via map $\pi$, especially the P=C conjecture posed by Kononov-Pi-Shen. We show that P=C conjecture holds for $H^{*\leq 4}(M(d,\chi),\mathbb{Q})$ for any $d\geq 4$, $(d,\chi)=1$. The main strategy is to relate $M(d,\chi)$ to the Hilbert scheme $S^{[n]}$ of $n$-points and transfer the problem to some properties on $H^*(S^{[n]},\mathbb{Q})$. We use induction on $n$ to achieve the desired properties. Our proof involves some complicated calculations.


title: On Density Functional Theory models for one-dimensional homogeneous materials

abstract: This paper studies DFT models for homogeneous 1D materials in the 3D space. It follows our previous work about DFT models for homogeneous 2D materials in 3D. We show how to reduce the problem from a 3D energy functional to a 2D energy functional. The kinetic energy is treated as in the 2D case by diagonilizing admissible states, and writing the kinetic energy as the infimum of a modified kinetic energy functional on reduced states. Besides, we treat here the Hartree interaction term in 2D, and show how to properly define the mean-field potential, through Riesz potential. We then show the well posdness of the reduced model and present some numerical illustrations.


title: Local certification of unitary operations and von Neumann measurements

abstract: In this work, we analyze the local certification of unitary quantum channels and von Neumann measurements, which is a natural extension of quantum hypothesis testing. A particular case of a quantum channel and von Neumann measurement, operating on two systems corresponding to product states at the input, is considered. The goal is to minimize the probability of the type II error, given a specified maximum probability of the type I error, considering assistance through entanglement. We introduce a new mathematical structure q-product numerical range, which is a natural generalization of the q-numerical range, used to obtain result, when dealing with one system. In our findings, we employ the q-product numerical range as a pivotal tool, leveraging its properties to derive our results and minimize the probability of type II error under the constraint of type I error probability. We show a fundamental dependency: for local certification, the tensor product structure inherently manifests, necessitating the transition from q-numerical range to q-product numerical range.


title: Irreducible representations of the inhomogeneous Lorentz group with two-fold Wigner degeneracy

abstract: Not all complete set of spinors can be used as expansion coefficients of a quantum field. In fact, Steven Weinberg established the uniqueness of Dirac spinors for this purpose provided: (a) one paid due attention to the multiplicative phases for each of the spinors, and (b) one paired these to creation and annihilation operators in a specific manner. This is implicit in his implementation of the rotational symmetry for the spin half quantum field. Among the numerous complete set of spinors that are available to a physicist, Elko occupies a unique status that allows it to enter as expansion coefficients of a quantum field without violating Weinberg's no go theorem. How this paradigm changing claim arises is the primary subject of this communication. Weinberg's no go theorem is evaded by exploiting a uniquely special feature of Elko that allows us to introduce a doubling of the particle-antiparticle degrees of freedom from four to eight. Weinberg had dismissed this degeneracy on the ground that, "no examples are known of particles that furnish unconventional representations of inversions." Here we will find that this degeneracy, once envisioned by Eugene Wigner, in fact gives rise to a quantum field that has all the theoretical properties required of dark matter.


title: Quantum Liquid in Lower Dimensions: From the perspective of Surface Tension

abstract: We analyze the surface tension in ultra-cold atomic gases in a quasi one-dimensional and one-dimensional geometry. In recent years, experimental observations have confirmed the ``clustering of atoms" to form droplets in ultra-cold atomic gases and the emergence of this new phase is attributed to the beyond mean-field interaction. However, two decades earlier, liquid formation was predicted due to the competition of two-body and three-body interactions. Here, we review both propositions and comment on the role of beyond mean-field and three-body interaction in liquid formation by calculating the surface tension.


title: AI Powered Road Network Prediction with Multi-Modal Data

abstract: This study presents an innovative approach for automatic road detection with deep learning, by employing fusion strategies for utilizing both lower-resolution satellite imagery and GPS trajectory data, a concept never explored before. We rigorously investigate both early and late fusion strategies, and assess deep learning based road detection performance using different fusion settings. Our extensive ablation studies assess the efficacy of our framework under diverse model architectures, loss functions, and geographic domains (Istanbul and Montreal). For an unbiased and complete evaluation of road detection results, we use both region-based and boundary-based evaluation metrics for road segmentation. The outcomes reveal that the ResUnet model outperforms U-Net and D-Linknet in road extraction tasks, achieving superior results over the benchmark study using low-resolution Sentinel-2 data. This research not only contributes to the field of automatic road detection but also offers novel insights into the utilization of data fusion methods in diverse applications.


title: Atomic mass determination of uranium-238

abstract: The atomic mass of uranium-238 has been determined to be $238.050\,787\,618(15)\,\text{u}$, improving the literature uncertainty by two orders of magnitude. It is obtained from a measurement of the mass ratio of $^{238}$U$^{47+}$ and $^{132}$Xe$^{26+}$ ions with an uncertainty of $3.5\times 10^{-12}$. The measurement was carried out with the Penning-trap mass spectrometer \textsc{Pentatrap} and was accompanied by a calculation of the binding energies $E_{\text{U}}$ and $E_{\text{Xe}}$ of the 47 and 26 missing electrons of the two highly charged ions, respectively. These binding energies were determined using an \textit{ab initio} multiconfiguration Dirac-Hartree-Fock (MCDHF) method to be $E_{\text{U}} = 39\,927(10)\,\text{eV}$ and $E_{\text{Xe}} = 8\,971.2(21)\,\text{eV}$. The new mass value will serve as a reference for high-precision mass measurements in the heavy mass region of the nuclear chart up to transuranium nuclides.


title: High-order Finite-Volume Central Targeted ENO Family Scheme for Compressible Flows in Unstructured Meshes

abstract: Due to its innovative weighting method, the high-order target ENO (TENO) system has shown tremendous potential for complicated flow prediction. For unstructured meshes, we have developed non-oscillatory central target ENO family schemes in this study. In comparison with standard WENO schemes, the compact directional stencils significantly enhance the possibility that one of them will be in smooth area. The scheme is inherently limited in size in order to simplify the directional stencils in implementation. Following an effective scale separation method, we employ the ENO-like stencil selection technique, which selects candidate reconstructions from large central stencils in smooth areas to enforce the ENO property and from small directional stencils at discontinuities to restore high-order accuracy. With the validation of a number of test cases, a detailed comparison of CWENO, TENO, CTENO and CTENOZ schemes was carried out to assess their performance based on accuracy, robustness, parallel scalability and run time. Our findings demonstrate high-order precision, lower numerical dissipation, and superior sharp shock-capturing performance of proposed CTENO and CTENOZ schemes.


title: Collatz-Weyl Generators: High Quality and High Throughput Parameterized Pseudorandom Number Generators

abstract: We introduce the Collatz-Weyl Generators, a family of uniform pseudorandom number generators (PRNGs) which are based on generalized Collatz mappings, derived from the Collatz conjecture and Weyl sequences. The high-quality statistical properties of our generators is demonstrated by the fact that they pass stringent randomness tests used by the research and standardization community. The proposed Collatz-Weyl Generators have a number of important properties, including solid mathematical foundations, enablement of high throughput and low latency implementation, small code and/or ASIC size, enablement of producing multiple independent streams and potential of support of cryptographic applications.


title: Length Extrapolation of Transformers: A Survey from the Perspective of Positional Encoding

abstract: Transformer has taken the field of natural language processing (NLP) by storm since its birth. Further, Large language models (LLMs) built upon it have captured worldwide attention due to its superior abilities. Nevertheless, all Transformer-based models including these powerful LLMs suffer from a preset length limit and can hardly generalize from short training sequences to longer inference ones, namely, they can not perform length extrapolation. Hence, a plethora of methods have been proposed to enhance length extrapolation of Transformer, in which the positional encoding (PE) is recognized as the major factor. In this survey, we present these advances towards length extrapolation in a unified notation from the perspective of PE. Specifically, we first introduce extrapolatable PEs, including absolute and relative PEs. Then, we dive into extrapolation methods based on them, covering position interpolation and randomized position methods. Finally, several challenges and future directions in this area are highlighted. Through this survey, We aim to enable the reader to gain a deep understanding of existing methods and provide stimuli for future research.


title: Properties of Immersions for Systems with Multiple Limit Sets with Implications to Learning Koopman Embeddings

abstract: Linear immersions (or Koopman eigenmappings) of a nonlinear system have wide applications in prediction and control. In this work, we study the properties of linear immersions for nonlinear systems with multiple omega-limit sets. While previous research has indicated the possibility of discontinuous one-to-one linear immersions for such systems, it has been unclear whether continuous one-to-one linear immersions are attainable. Under mild conditions, we prove that any continuous immersion to a class of systems including linear systems collapses all the omega-limit sets, and thus cannot be one-to-one. Furthermore, we show that this property is also shared by approximate linear immersions learned from data as sample size increases and sampling interval decreases. Multiple examples are studied to illustrate our results.


title: Representing and Modeling Inconsistent, Impossible, and Incoherent Shapes and Scenes with 2D Non-Conservative Vector Fields mapped on 2-Complexes

abstract: In this paper, we present a framework to represent mock 3D objects and scenes, which are not 3D but appear 3D. In our framework, each mock-3D object is represented using 2D non-conservative vector fields and thickness information that are mapped on 2-complexes. Mock-3D scenes are simply scenes consisting of more than one mock-3D object. We demonstrated that using this representation, we can dynamically compute a 3D shape using rays emanating from any given point in 3D. These mock-3D objects are view-dependent since their computed shapes depend on the positions of ray centers. Using these dynamically computed shapes, we can compute shadows, reflections, and refractions in real time. This representation is mainly useful for 2D artistic applications to model incoherent, inconsistent, and impossible objects. Using this representation, it is possible to obtain expressive depictions with shadows and global illumination effects. The representation can also be used to convert existing 2D artworks into a Mock-3D form that can be interactively re-rendered.


title: Inconsistency of cross-validation for structure learning in Gaussian graphical models

abstract: Despite numerous years of research into the merits and trade-offs of various model selection criteria, obtaining robust results that elucidate the behavior of cross-validation remains a challenging endeavor. In this paper, we highlight the inherent limitations of cross-validation when employed to discern the structure of a Gaussian graphical model. We provide finite-sample bounds on the probability that the Lasso estimator for the neighborhood of a node within a Gaussian graphical model, optimized using a prediction oracle, misidentifies the neighborhood. Our results pertain to both undirected and directed acyclic graphs, encompassing general, sparse covariance structures. To support our theoretical findings, we conduct an empirical investigation of this inconsistency by contrasting our outcomes with other commonly used information criteria through an extensive simulation study. Given that many algorithms designed to learn the structure of graphical models require hyperparameter selection, the precise calibration of this hyperparameter is paramount for accurately estimating the inherent structure. Consequently, our observations shed light on this widely recognized practical challenge.