title: QEAN: Quaternion-Enhanced Attention Network for Visual Dance Generation

abstract: The study of music-generated dance is a novel and challenging Image generation task. It aims to input a piece of music and seed motions, then generate natural dance movements for the subsequent music. Transformer-based methods face challenges in time series prediction tasks related to human movements and music due to their struggle in capturing the nonlinear relationship and temporal aspects. This can lead to issues like joint deformation, role deviation, floating, and inconsistencies in dance movements generated in response to the music. In this paper, we propose a Quaternion-Enhanced Attention Network (QEAN) for visual dance synthesis from a quaternion perspective, which consists of a Spin Position Embedding (SPE) module and a Quaternion Rotary Attention (QRA) module. First, SPE embeds position information into self-attention in a rotational manner, leading to better learning of features of movement sequences and audio sequences, and improved understanding of the connection between music and dance. Second, QRA represents and fuses 3D motion features and audio features in the form of a series of quaternions, enabling the model to better learn the temporal coordination of music and dance under the complex temporal cycle conditions of dance generation. Finally, we conducted experiments on the dataset AIST++, and the results show that our approach achieves better and more robust performance in generating accurate, high-quality dance movements. Our source code and dataset can be available from https://github.com/MarasyZZ/QEAN and https://google.github.io/aistplusplus_dataset respectively.


title: LoRA-Composer: Leveraging Low-Rank Adaptation for Multi-Concept Customization in Training-Free Diffusion Models

abstract: Customization generation techniques have significantly advanced the synthesis of specific concepts across varied contexts. Multi-concept customization emerges as the challenging task within this domain. Existing approaches often rely on training a Low-Rank Adaptations (LoRA) fusion matrix of multiple LoRA to merge various concepts into a single image. However, we identify this straightforward method faces two major challenges: 1) concept confusion, which occurs when the model cannot preserve distinct individual characteristics, and 2) concept vanishing, where the model fails to generate the intended subjects. To address these issues, we introduce LoRA-Composer, a training-free framework designed for seamlessly integrating multiple LoRAs, thereby enhancing the harmony among different concepts within generated images. LoRA-Composer addresses concept vanishing through Concept Injection Constraints, enhancing concept visibility via an expanded cross-attention mechanism. To combat concept confusion, Concept Isolation Constraints are introduced, refining the self-attention computation. Furthermore, Latent Re-initialization is proposed to effectively stimulate concept-specific latent within designated regions. Our extensive testing showcases a notable enhancement in LoRA-Composer's performance compared to standard baselines, especially when eliminating the image-based conditions like canny edge or pose estimations. Code is released at https://github.com/Young98CN/LoRA\_Composer.


title: Characteristics of the fission fragments in the three-body model of binary fission

abstract: The evaluated nuclide yields, fragment mass and charge distributions, and averaged total kinetic energy of fission fragments for the neutron-induced fission of 30 actinide nuclei are well described in the new model, which considers the fissioning scission system consisting of two heavy fragments and an alpha-particle between them. The alpha-particle has its origin in the neck nucleons. The yield of fission fragments in the model is linked to the number of states over the barrier of the saddle point, which is between the contacting and well-separated fission fragments. The alpha-particle is fused with the nearest heavy fragment after passing the saddle point, therefore, two final fragments appear during fission. The quadrupole deformations of heavy fragments are taken into account in the model. The fragment yields depend on the heights of corresponding saddle points and the values of the equilibrium quadrupole deformation of fragments.


title: GLACE survey: OSIRIS/GTC tuneable imaging of the galaxy cluster ZwCl 0024.0+1652 II. The mass--metallicity relationship and the effect of the environment

abstract: In this paper, we revisit the data for the galaxy cluster ZwCl 0024.0+1652 provided by the GLACE survey and study the mass--metallicity function and its relationship with the environment. Here we describe an alternative way to reduce the data from OSIRIS tunable filters. This method gives us better uncertainties in the fluxes of the emission lines and the derived quantities. We present an updated catalogue of cluster galaxies with emission in H$\alpha$ and [N\,{\sc{ii}}] $\lambda\lambda$6548,6583. We also discuss the biases of these new fluxes and describe the way in which we calculated the mass--metallicity relationship and its uncertainties. We generated a new catalogue of 84 emission-line galaxies with reliable fluxes in [N\,{\sc{ii}}] and H$\alpha$ lines from a list of 174 galaxies. We find a relationship between the clustercentric radius and the density of galaxies. We derived the mass--metallicity relationship for ZwCl 0024.0+1652 and compared it with clusters and field galaxies from the literature. We find a difference in the mass--metallicity relationship when compared to more massive clusters, with the latter showing on average higher values of abundance. This could be an effect of the quenching of the star formation, which seems to be more prevalent in low-mass galaxies in more massive clusters. We find little to no difference between ZwCl 0024.0+1652 galaxies and field galaxies located at the same redshift.


title: Nonlinear Pulse Dynamics in a Magnetized and Nonextensive Quark-Gluon Plasma

abstract: We investigate the propagation of nonlinear energy density waves in a nonextensive quark-gluon plasma under the influence of a magnetic field using the reductive perturbation technique. For a nonextensive MIT bag equation of state, we obtain the governing equation for the first order perturbation of the energy density. We observe that an increase in the strength of the magnetic field results in the localization of the waves.


title: Compositional Kronecker Context Optimization for Vision-Language Models

abstract: Context Optimization (CoOp) has emerged as a simple yet effective technique for adapting CLIP-like vision-language models to downstream image recognition tasks. Nevertheless, learning compact context with satisfactory base-to-new, domain and cross-task generalization ability while adapting to new tasks is still a challenge. To tackle such a challenge, we propose a lightweight yet generalizable approach termed Compositional Kronecker Context Optimization (CK-CoOp). Technically, the prompt's context words in CK-CoOp are learnable vectors, which are crafted by linearly combining base vectors sourced from a dictionary. These base vectors consist of a non-learnable component obtained by quantizing the weights in the token embedding layer, and a learnable component constructed by applying Kronecker product on several learnable tiny matrices. Intuitively, the compositional structure mitigates the risk of overfitting on training data by remembering more pre-trained knowledge. Meantime, the Kronecker product breaks the non-learnable restrictions of the dictionary, thereby enhancing representation ability with minimal additional parameters. Extensive experiments confirm that CK-CoOp achieves state-of-the-art performance under base-to-new, domain and cross-task generalization evaluation, but also has the metrics of fewer learnable parameters and efficient training and inference speed.


title: Data-driven Stabilization of Nitsche's Method

abstract: The weak imposition of essential boundary conditions is an integral aspect of unfitted finite element methods, where the physical boundary does not in general coincide with the computational domain. In this regard, the symmetric Nitsche's method is a powerful technique that preserves the symmetry and variational consistency of the unmodified weak formulation. The stabilization parameter in Nitsche's method plays a crucial role in the stability of the resultant formulation, whose estimation is computationally intensive and dependent on the particular cut configuration using the conventional eigenvalue-based approach. In this work, we employ as model problem the finite cell method in which the need for the generation of a boundary-conforming mesh is circumvented by embedding the physical domain in a, typically regular, background mesh. We propose a data-driven estimate based on machine learning methods for the estimation of the stabilization parameter in Nitsche's method that offers an efficient constant-complexity alternative to the eigenvalue-based approach independent of the cut configuration. It is shown, using numerical benchmarks, that the proposed method can estimate the stabilization parameter accurately and is by far more computationally efficient. The data-driven estimate can be integrated into existing numerical codes with minimal modifications and thanks to the wide adoption of accelerators such as GPUs by machine learning frameworks, can be used with virtually no extra implementation cost on GPU devices, further increasing the potential for computational gains over the conventional eigenvalue-based estimate.


title: Cooperative Agri-Food Export under Minimum Quantity Commitments

abstract: International trade can be a profitable business for agri-food communities. However, access to international markets can be costly and thus unattainable for small and medium sized enterprises (SMEs). This problem is exacerbated under trade policies which require minimum quantity commitments (MQCs) on export volumes, e.g., licensing tariff rate quota (TRQ) mechanisms. We show how cooperative exporting among agri-food SMEs can tackle the barriers posed by the MQCs, and give market access to a broader range of SMEs. We formulate a class of cooperative games associated with these situations and find a gain-sharing mechanism that result in allocations in their corresponding cores. Thus, grand coalitions of cooperative exporting SMEs can form in stable manners. This allocation rule shares the export surplus only among the "essential" SME exporters, that is, the players who are sufficiently cost efficient. Thus, less cost efficient "complimentary" SMEs whose capacities are needed to maintain MQCs receive no benefit from collaborative exporting and their participation have to be altruistic. We propose two modifications to our original allocation rule to share a portion of export surplus among the complementary SMEs through taxing the essential SMEs: the first through egalitarian, and the second through revenue-based rates. We compare the performance of these allocations with the numerical examples and discuss their practical implications.


title: Personalized 3D Human Pose and Shape Refinement

abstract: Recently, regression-based methods have dominated the field of 3D human pose and shape estimation. Despite their promising results, a common issue is the misalignment between predictions and image observations, often caused by minor joint rotation errors that accumulate along the kinematic chain. To address this issue, we propose to construct dense correspondences between initial human model estimates and the corresponding images that can be used to refine the initial predictions. To this end, we utilize renderings of the 3D models to predict per-pixel 2D displacements between the synthetic renderings and the RGB images. This allows us to effectively integrate and exploit appearance information of the persons. Our per-pixel displacements can be efficiently transformed to per-visible-vertex displacements and then used for 3D model refinement by minimizing a reprojection loss. To demonstrate the effectiveness of our approach, we refine the initial 3D human mesh predictions of multiple models using different refinement procedures on 3DPW and RICH. We show that our approach not only consistently leads to better image-model alignment, but also to improved 3D accuracy.


title: The FAST Galactic Plane Pulsar Snapshot Survey -- V. PSR J1901+0658 in a double neutron star system

abstract: Double neutron star (DNS) systems offer excellent opportunities to test gravity theories. We report the timing results of PSR J1901+0658, the first pulsar discovered in the FAST Galactic Plane Pulsar Snapshot (GPPS) Survey. Based on timing observations by FAST over 5 yr, we obtain the phase-coherent timing solutions and derive the precise measurements of its position, spin parameters, orbital parameters, and dispersion measure. It has a period of 75.7 ms, a period derivative of 2.169(6)$\times 10^{-19}$ s s$^{-1}$, and a characteristic age of 5.5 Gyr. This pulsar is in an orbit with a period of 14.45 d and an eccentricity of 0.366. One post-Keplerian parameter, periastron advance, has been well-measured as being 0.00531(9) deg yr$^{-1}$, from which the total mass of this system is derived to be 2.79(7) M$_{\odot}$. The pulsar has the mass upper limit of 1.68 M$_{\odot}$, so the lower limit for the companion mass is 1.11 M$_{\odot}$. Because PSR J1901+0658 is a partially recycled pulsar in an eccentric binary orbit with such a large companion mass, it should be in a DNS system according to the evolution history of the binary system.


title: A restricted additive smoother for finite cell flow problems

abstract: In this work, we propose an adaptive geometric multigrid method for the solution of large-scale finite cell flow problems. The finite cell method seeks to circumvent the need for a boundary-conforming mesh through the embedding of the physical domain in a regular background mesh. As a result of the intersection between the physical domain and the background computational mesh, the resultant systems of equations are typically numerically ill-conditioned, rendering the appropriate treatment of cutcells a crucial aspect of the solver. To this end, we propose a smoother operator with favorable parallel properties and discuss its memory footprint and parallelization aspects. We propose three cache policies that offer a balance between cached and on-the-fly computation and discuss the optimization opportunities offered by the smoother operator. It is shown that the smoother operator, on account of its additive nature, can be replicated in parallel exactly with little communication overhead, which offers a major advantage in parallel settings as the geometric multigrid solver is consequently independent of the number of processes. The convergence and scalability of the geometric multigrid method is studied using numerical examples. It is shown that the iteration count of the solver remains bounded independent of the problem size and depth of the grid hierarchy. The solver is shown to obtain excellent weak and strong scaling using numerical benchmarks with more than 665 million degrees of freedom. The presented geometric multigrid solver is, therefore, an attractive option for the solution of large-scale finite cell problems in massively parallel high-performance computing environments.


title: The Value of Reward Lookahead in Reinforcement Learning

abstract: In reinforcement learning (RL), agents sequentially interact with changing environments while aiming to maximize the obtained rewards. Usually, rewards are observed only after acting, and so the goal is to maximize the expected cumulative reward. Yet, in many practical settings, reward information is observed in advance -- prices are observed before performing transactions; nearby traffic information is partially known; and goals are oftentimes given to agents prior to the interaction. In this work, we aim to quantifiably analyze the value of such future reward information through the lens of competitive analysis. In particular, we measure the ratio between the value of standard RL agents and that of agents with partial future-reward lookahead. We characterize the worst-case reward distribution and derive exact ratios for the worst-case reward expectations. Surprisingly, the resulting ratios relate to known quantities in offline RL and reward-free exploration. We further provide tight bounds for the ratio given the worst-case dynamics. Our results cover the full spectrum between observing the immediate rewards before acting to observing all the rewards before the interaction starts.


title: On systems of fractional nonlinear partial differential equations

abstract: The work considers a system of fractional order partial differential equations. The existence and uniqueness theorems for the classical solution of initial-boundary value problems are proved in two cases: 1) the right-hand side of the equation does not depend on the solution of the problem and 2) it depends on the solution, but at the same time satisfies the classical Lipschitz condition with respect to this variable and an additional condition which guarantees a global existence of the solution. Sufficient conditions are found (in some cases they are necessary) on the initial function and on the right-hand side of the equation, which ensure the existence of a classical solution. In previously known works, linear but more general systems of fractional pseudodifferential equations were considered and the existence of a weak solution was proven in the special classes of distributions.


title: An Accurate and Real-time Relative Pose Estimation from Triple Point-line Images by Decoupling Rotation and Translation

abstract: Line features are valid complements for point features in man-made environments. 3D-2D constraints provided by line features have been widely used in Visual Odometry (VO) and Structure-from-Motion (SfM) systems. However, how to accurately solve three-view relative motion only with 2D observations of points and lines in real time has not been fully explored. In this paper, we propose a novel three-view pose solver based on rotation-translation decoupled estimation. First, a high-precision rotation estimation method based on normal vector coplanarity constraints that consider the uncertainty of observations is proposed, which can be solved by Levenberg-Marquardt (LM) algorithm efficiently. Second, a robust linear translation constraint that minimizes the degree of the rotation components and feature observation components in equations is elaborately designed for estimating translations accurately. Experiments on synthetic data and real-world data show that the proposed approach improves both rotation and translation accuracy compared to the classical trifocal-tensor-based method and the state-of-the-art two-view algorithm in outdoor and indoor environments.


title: Quasinormal Modes of Near-Extremal Electric and Magnetic Black Branes

abstract: Gauge-gravity duality provides a robust mathematical framework for studying the behavior of strongly coupled non-abelian plasmas both near and far away from thermodynamic equilibrium. In particular, their near-equilibrium transport coefficients such as viscosity, conductivity, diffusion constants, etc. can be determined from poles of the retarded Green's function which are the dissipative eigenmodes i.e., the quasinormal modes (QNMs) of the dual gravitational field equations. The AdS5/CFT4 correspondence admits the description of a strongly coupled $\mathcal{N}$= 4 Supersymmetric Yang Mills (SYM) plasma at non-zero temperature as a dual AdS5 black brane geometry. We demonstrate the application of pseudospectral methods to solving the dual Einstein field equations using the example of homogenous isotropization in $\mathcal{N}$= 4 SYM plasma far from equilibrium. Using this framework, we also compute the quasinormal modes of electrically (Reissner-Nordstrom) and magnetically charged AdS5 black branes for the case of vanishing spatial momenta. The near-extremal behavior of these QNMs is analyzed for both types of black branes.


title: Arc2Face: A Foundation Model of Human Faces

abstract: This paper presents Arc2Face, an identity-conditioned face foundation model, which, given the ArcFace embedding of a person, can generate diverse photo-realistic images with an unparalleled degree of face similarity than existing models. Despite previous attempts to decode face recognition features into detailed images, we find that common high-resolution datasets (e.g. FFHQ) lack sufficient identities to reconstruct any subject. To that end, we meticulously upsample a significant portion of the WebFace42M database, the largest public dataset for face recognition (FR). Arc2Face builds upon a pretrained Stable Diffusion model, yet adapts it to the task of ID-to-face generation, conditioned solely on ID vectors. Deviating from recent works that combine ID with text embeddings for zero-shot personalization of text-to-image models, we emphasize on the compactness of FR features, which can fully capture the essence of the human face, as opposed to hand-crafted prompts. Crucially, text-augmented models struggle to decouple identity and text, usually necessitating some description of the given face to achieve satisfactory similarity. Arc2Face, however, only needs the discriminative features of ArcFace to guide the generation, offering a robust prior for a plethora of tasks where ID consistency is of paramount importance. As an example, we train a FR model on synthetic images from our model and achieve superior performance to existing synthetic datasets.


title: Guiding the generation of counterfactual explanations through temporal background knowledge for Predictive Process Monitoring

abstract: Counterfactual explanations suggest what should be different in the input instance to change the outcome of an AI system. When dealing with counterfactual explanations in the field of Predictive Process Monitoring, however, control flow relationships among events have to be carefully considered. A counterfactual, indeed, should not violate control flow relationships among activities (temporal background knowledege). Within the field of Explainability in Predictive Process Monitoring, there have been a series of works regarding counterfactual explanations for outcome-based predictions. However, none of them consider the inclusion of temporal background knowledge when generating these counterfactuals. In this work, we adapt state-of-the-art techniques for counterfactual generation in the domain of XAI that are based on genetic algorithms to consider a series of temporal constraints at runtime. We assume that this temporal background knowledge is given, and we adapt the fitness function, as well as the crossover and mutation operators, to maintain the satisfaction of the constraints. The proposed methods are evaluated with respect to state-of-the-art genetic algorithms for counterfactual generation and the results are presented. We showcase that the inclusion of temporal background knowledge allows the generation of counterfactuals more conformant to the temporal background knowledge, without however losing in terms of the counterfactual traditional quality metrics.


title: Diffusion-Based Environment-Aware Trajectory Prediction

abstract: The ability to predict the future trajectories of traffic participants is crucial for the safe and efficient operation of autonomous vehicles. In this paper, a diffusion-based generative model for multi-agent trajectory prediction is proposed. The model is capable of capturing the complex interactions between traffic participants and the environment, accurately learning the multimodal nature of the data. The effectiveness of the approach is assessed on large-scale datasets of real-world traffic scenarios, showing that our model outperforms several well-established methods in terms of prediction accuracy. By the incorporation of differential motion constraints on the model output, we illustrate that our model is capable of generating a diverse set of realistic future trajectories. Through the use of an interaction-aware guidance signal, we further demonstrate that the model can be adapted to predict the behavior of less cooperative agents, emphasizing its practical applicability under uncertain traffic conditions.


title: A tree-approach Pauli decomposition algorithm with application to quantum computing

abstract: The Pauli matrices are 2-by-2 matrices that are very useful in quantum computing. They can be used as elementary gates in quantum circuits but also to decompose any matrix of $\mathbb{C}^{2^n \times 2^n}$ as a linear combination of tensor products of the Pauli matrices. However, the computational cost of this decomposition is potentially very expensive since it can be exponential in $n$. In this paper, we propose an algorithm with a parallel implementation that optimizes this decomposition using a tree approach to avoid redundancy in the computation while using a limited memory footprint. We also explain how some particular matrix structures can be exploited to reduce the number of operations. We provide numerical experiments to evaluate the sequential and parallel performance of our decomposition algorithm and we illustrate how this algorithm can be applied to encode matrices in a quantum memory.


title: Many-body quantum heat engines based on free-fermion systems

abstract: We study the performances of an imperfect quantum many-body Otto engine based on free-fermion systems. Starting from the thermodynamic definitions of heat and work along ideal isothermal, adiabatic, and isochoric transformations, we generalize these expressions in the case when the hypotheses of ideality are relaxed (i.e., nonperfect thermalization with the external baths, as well as nonperfect quantum adiabaticity in the unitary dynamic protocols). These results are used to evaluate the work and the power delivered by an imperfect quantum many-body heat engine in a finite time, whose working substance is constituted by a quantum Ising chain in a transverse field: We discuss the emerging optimal working points as functions of the various model parameters.


title: MedMerge: Merging Models for Effective Transfer Learning to Medical Imaging Tasks

abstract: Transfer learning has become a powerful tool to initialize deep learning models to achieve faster convergence and higher performance. This is especially useful in the medical imaging analysis domain, where data scarcity limits possible performance gains for deep learning models. Some advancements have been made in boosting the transfer learning performance gain by merging models starting from the same initialization. However, in the medical imaging analysis domain, there is an opportunity in merging models starting from different initialisations, thus combining the features learnt from different tasks. In this work, we propose MedMerge, a method whereby the weights of different models can be merged, and their features can be effectively utilized to boost performance on a new task. With MedMerge, we learn kernel-level weights that can later be used to merge the models into a single model, even when starting from different initializations. Testing on various medical imaging analysis tasks, we show that our merged model can achieve significant performance gains, with up to 3% improvement on the F1 score. The code implementation of this work will be available at www.github.com/BioMedIA-MBZUAI/MedMerge.


title: Lattice QCD estimates of thermal photon production from the QGP

abstract: Thermal photons produced in heavy-ion collision experiments are an important observable for understanding quark-gluon plasma (QGP). The thermal photon rate from the QGP at a given temperature can be calculated from the spectral function of the vector current correlator. Extraction of the spectral function from the lattice correlator is known to be an ill-conditioned problem, as there is no unique solution for a spectral function for a given lattice correlator with statistical errors. The vector current correlator, on the other hand, receives a large ultraviolet contribution from the vacuum, which makes the extraction of the thermal photon rate difficult from this channel. We therefore consider the difference between the transverse and longitudinal part of the spectral function, only capturing the thermal contribution to the current correlator, simplifying the reconstruction significantly. The lattice correlator is calculated for light quarks in quenched QCD at $T=470~$MeV ($\sim 1.5\, T_c$), as well as in 2+1 flavor QCD at $T=220~$MeV ($\sim 1.2 \, T_{pc}$) with $m_{\pi}=320$ MeV. In order to quantify the non-perturbative effects, the lattice correlator is compared with the corresponding $\text{NLO}+\text{LPM}^{\text{LO}}$ estimate of correlator. The reconstruction of the spectral function is performed in several different frameworks, ranging from physics-informed models of the spectral function to more general models in the Backus-Gilbert method and Gaussian Process regression. We find that the resulting photon rates agree within errors.


title: Vehicle single track modeling using physics guided neural differential equations

abstract: In this paper, we follow the physics guided modeling approach and integrate a neural differential equation network into the physical structure of a vehicle single track model. By relying on the kinematic relations of the single track ordinary differential equations (ODE), a small neural network and few training samples are sufficient to substantially improve the model accuracy compared with a pure physics based vehicle single track model. To be more precise, the sum of squared error is reduced by 68% in the considered scenario. In addition, it is demonstrated that the prediction capabilities of the physics guided neural ODE model are superior compared with a pure black box neural differential equation approach.


title: Gridless 2D Recovery of Lines using the Sliding Frank-Wolfe Algorithm

abstract: We present a new approach leveraging the Sliding Frank--Wolfe algorithm to address the challenge of line recovery in degraded images. Building upon advances in conditional gradient methods for sparse inverse problems with differentiable measurement models, we propose two distinct models tailored for line detection tasks within the realm of blurred line deconvolution and ridge detection of linear chirps in spectrogram images.


title: Prioritized Semantic Learning for Zero-shot Instance Navigation

abstract: We study zero-shot instance navigation, in which the agent navigates to a specific object without using object annotations for training. Previous object navigation approaches apply the image-goal navigation (ImageNav) task (go to the location of an image) for pretraining, and transfer the agent to achieve object goals using a vision-language model. However, these approaches lead to issues of semantic neglect, where the model fails to learn meaningful semantic alignments. In this paper, we propose a Prioritized Semantic Learning (PSL) method to improve the semantic understanding ability of navigation agents. Specifically, a semantic-enhanced PSL agent is proposed and a prioritized semantic training strategy is introduced to select goal images that exhibit clear semantic supervision and relax the reward function from strict exact view matching. At inference time, a semantic expansion inference scheme is designed to preserve the same granularity level of the goal-semantic as training. Furthermore, for the popular HM3D environment, we present an Instance Navigation (InstanceNav) task that requires going to a specific object instance with detailed descriptions, as opposed to the Object Navigation (ObjectNav) task where the goal is defined merely by the object category. Our PSL agent outperforms the previous state-of-the-art by 66% on zero-shot ObjectNav in terms of success rate and is also superior on the new InstanceNav task. Code will be released at https://anonymous.4open. science/r/PSL/.


title: Overfitted image coding at reduced complexity

abstract: Overfitted image codecs offer compelling compression performance and low decoder complexity, through the overfitting of a lightweight decoder for each image. Such codecs include Cool-chic, which presents image coding performance on par with VVC while requiring around 2000 multiplications per decoded pixel. This paper proposes to decrease Cool-chic encoding and decoding complexity. The encoding complexity is reduced by shortening Cool-chic training, up to the point where no overfitting is performed at all. It is also shown that a tiny neural decoder with 300 multiplications per pixel still outperforms HEVC. A near real-time CPU implementation of this decoder is made available at https://orange-opensource.github.io/Cool-Chic/.


title: Small-scale magnetic flux emergence preceding a chain of energetic solar atmospheric events

abstract: Advancements in instrumentation have revealed a multitude of small-scale EUV events in the solar atmosphere. Our aim is to employ high-resolution magnetograms to gain a detailed understanding of the magnetic origin of such phenomena. We have used coordinated observations from SST, IRIS, and SDO to analyze an ephemeral magnetic flux emergence episode and the following chain of small-scale energetic events. These unique observations clearly link these phenomena together. The high-resolution (0."057/pixel) magnetograms obtained with SST/CRISP allows us to reliably measure the magnetic field at the photosphere and detect the emerging bipole that causes the subsequent eruptive atmospheric events. Notably, this small-scale emergence episode remains indiscernible in the lower resolution SDO/HMI magnetograms (0."5/pixel). We report the appearance of a dark bubble in Ca II K related to the emerging bipole, a sign of the canonical expanding magnetic dome predicted in flux emergence simulations. Evidences of reconnection are also found: first through an Ellerman bomb, and later by the launch of a surge next to a UV burst. The UV burst exhibits a weak EUV counterpart in the coronal SDO/AIA channels. By calculating DEM, its plasma is shown to reach a temperature beyond 1 MK and have densities between the upper chromosphere and transition region. Our study showcases the importance of high-resolution magnetograms to unveil the mechanisms triggering phenomena such as EBs, UV bursts, and surges. This could hold implications for small-scale events akin to those recently reported in EUV using Solar Orbiter. The finding of temperatures beyond 1 MK in the UV burst plasma strongly suggests that we are examining analogous features. Therefore, we signal caution regarding drawing conclusions from full-disk magnetograms that lack the necessary resolution to reveal their true magnetic origin.


title: The temperature of the neutral Interstellar Medium in the Galaxy

abstract: Atomic Hydrogen-21 cm transition (HI) is an excellent tracer to study and understand the properties of the atomic gas in the Galaxy. Using the Westerbork Synthesis Radio Telescope (WSRT), we observed 12 quasar sightlines to detect galactic HI in absorption. We achieve an optical depth RMS of $\sim 1-2 \times 10^{-3}$, essential to detect the Warm Neutral Medium (WNM). We detect HI absorption in all our sightlines except along 1006+349, for which we set a strict upper limit on the spin temperature as $\langle T_s \rangle > 570$ K. We find around 50\% of our sightlines have $\langle T_s \rangle > 500$ K, indicating a WNM dominance. Further, we calculate an upper limit of the CNM fraction along our sightlines and find a median CNM fraction of $\sim 0.12$. With our observations, we reconfirm the existence of a threshold column density of $\sim 2 \times 10^{20} \ cm^{-2}$ to form CNM in the ISM. Using a two-temperature model of the HI disk, we explore the distribution of spin temperature in the Galactic ISM. We find that a simple fixed axisymmetric two-temperature model could not produce either the observed column density or the integral optical depth. This indicates the existence of a more complex distribution of spin temperatures in the Galaxy.


title: SRB measures for partially hyperbolic systems with one-dimensional center subbundles

abstract: For a partially hyperbolic attractor with a center bundle splitting in a dominatedway into one-dimensional subbundles we show that for Lebesgue almost every point there is anempirical measure from $x$ with a SRB component. Moreover if the center exponents are nonzero, then $x$ lies in the basin of an ergodic hyperbolic SRB measure and there are only finitely many such measures. This gives another proof of the existence of SRB measures in this context, which was established firstly in [11] by using random perturbations. Moreover this generalizes results of [15,18] which deal with a single one-dimensional center subbundle.


title: SU(3) gauge field of magnons in antiferromagnetic skyrmion crystals

abstract: Quasiparticle excitations in material solids often experience a fictitious gauge field, which can be a potential source of intriguing transport phenomena. Here, we show that low-energy excitations in insulating antiferromagnetic skyrmion crystals on the triangular lattice are effectively described by magnons with an SU(3) gauge field. The three-sublattice structure in the antiferromagnetic skyrmion crystals is inherited as three internal degrees of freedom for the magnons, which are coupled with their kinetic motion via the SU(3) gauge field that arises from the topologically nontrivial spin texture in real space. We also demonstrate that the non-commutativity of the SU(3) gauge field breaks an effective time-reversal symmetry and contributes to a magnon thermal Hall effect.


title: LocalStyleFool: Regional Video Style Transfer Attack Using Segment Anything Model

abstract: Previous work has shown that well-crafted adversarial perturbations can threaten the security of video recognition systems. Attackers can invade such models with a low query budget when the perturbations are semantic-invariant, such as StyleFool. Despite the query efficiency, the naturalness of the minutia areas still requires amelioration, since StyleFool leverages style transfer to all pixels in each frame. To close the gap, we propose LocalStyleFool, an improved black-box video adversarial attack that superimposes regional style-transfer-based perturbations on videos. Benefiting from the popularity and scalably usability of Segment Anything Model (SAM), we first extract different regions according to semantic information and then track them through the video stream to maintain the temporal consistency. Then, we add style-transfer-based perturbations to several regions selected based on the associative criterion of transfer-based gradient information and regional area. Perturbation fine adjustment is followed to make stylized videos adversarial. We demonstrate that LocalStyleFool can improve both intra-frame and inter-frame naturalness through a human-assessed survey, while maintaining competitive fooling rate and query efficiency. Successful experiments on the high-resolution dataset also showcase that scrupulous segmentation of SAM helps to improve the scalability of adversarial attacks under high-resolution data.


title: The fuzzy cores of Jupiter and Saturn

abstract: New interior models of Jupiter and Saturn suggest that both planets have "fuzzy cores". These cores should be viewed as central regions that are enriched with heavy elements but are not distinct from the rest of the deep interior. These cores may contain large amounts of hydrogen and helium though small pure-heavy element cores may also exist. New measurements along with advanced planetary modeling have revolutionized the way we think about the interiors of giant planets and provide important constraints for planet formation and evolution theories. These developments are also relevant for the characterization of giant exoplanets.


title: Negative Capacitance for Stabilizing Logic State in Tunnel Field-Effect Transistor

abstract: The study investigates the influence of negative capacitance on the transfer characteristics of vdW FETs on the heterophase of CIPS ferroelectric. Notably, a less pronounced NC resulting from the spatial distribution of the ferroelectric and paraelectric phases plays crucial role in stabilizing of n-channel-conductance. This results into the emergence of a non-volatile logic state, between the two binary states of TFETs. Concerned study proposed NC-TFETs based on ferroionic crystals as promising devices for generating a stable logic state below Vth.


title: Effective Computation of the Heegaard Genus of 3-Manifolds

abstract: The Heegaard genus is a fundamental invariant of 3-manifolds. However, computing the Heegaard genus of a triangulated 3-manifold is NP-hard, and while algorithms exist, little work has been done in making such an algorithm efficient and practical for implementation. Current algorithms use almost normal surfaces, which are an extension of the algorithm-friendly normal surface theory but which add considerable complexity for both running time and implementation. Here we take a different approach: instead of working with almost normal surfaces, we give a general method of modifying the input triangulation that allows us to avoid almost normal surfaces entirely. The cost is just four new tetrahedra, and the benefit is that important surfaces that were once almost normal can be moved to the simpler setting of normal surfaces in the new triangulation. We apply this technique to the computation of Heegaard genus, where we develop algorithms and heuristics that prove successful in practice when applied to a data set of 3,000 closed hyperbolic 3-manifolds; we precisely determine the genus for at least 2,705 of these.


title: Tailoring topological band properties of twisted double bilayer graphene: effects due to spin-orbit coupling

abstract: Our theoretical study unfolds the topological phase transitions (within bands of the Moir\'e super-lattice) in small angle twisted double bilayer graphene (tDBLG) under the influence of external gate voltage and intrinsic spin-orbit coupling (SOC) for both AB-AB and AB-BA stacking configurations. Utilizing a low-energy continuum model, we investigate the band structure and perform a comprehensive topological characterization of the system by analysing the direct band gap closing as well as various Chern numbers. In the absence of SOC, the tDBLG exhibits characteristics of a valley Hall insulator. However, in the presence of SOC, we observe a transition to a quantum spin Hall insulator state and band topology emerges in the parameter spaces of non-topological regime without SOC. Furthermore, we conduct a comparative analysis between untwisted double bilayer graphene and tDBLG to assess the impact of twisting on the system's properties. Our findings reveal the construction of topological phase diagrams that showcase distinct phases arising from changes in the twist angle compared to the untwisted case. These phase diagrams provide valuable insights into the diverse topological phases achievable in tDBLG with SOC. Our findings contribute to the understanding of the interplay between small twist angle, SOC, and external electric field on the topological band properties of twisted multilayer graphene systems.


title: Combining Local and Global Perception for Autonomous Navigation on Nano-UAVs

abstract: A critical challenge in deploying unmanned aerial vehicles (UAVs) for autonomous tasks is their ability to navigate in an unknown environment. This paper introduces a novel vision-depth fusion approach for autonomous navigation on nano-UAVs. We combine the visual-based PULP-Dronet convolutional neural network for semantic information extraction, i.e., serving as the global perception, with 8x8px depth maps for close-proximity maneuvers, i.e., the local perception. When tested in-field, our integration strategy highlights the complementary strengths of both visual and depth sensory information. We achieve a 100% success rate over 15 flights in a complex navigation scenario, encompassing straight pathways, static obstacle avoidance, and 90{\deg} turns.


title: FE-DeTr: Keypoint Detection and Tracking in Low-quality Image Frames with Events

abstract: Keypoint detection and tracking in traditional image frames are often compromised by image quality issues such as motion blur and extreme lighting conditions. Event cameras offer potential solutions to these challenges by virtue of their high temporal resolution and high dynamic range. However, they have limited performance in practical applications due to their inherent noise in event data. This paper advocates fusing the complementary information from image frames and event streams to achieve more robust keypoint detection and tracking. Specifically, we propose a novel keypoint detection network that fuses the textural and structural information from image frames with the high-temporal-resolution motion information from event streams, namely FE-DeTr. The network leverages a temporal response consistency for supervision, ensuring stable and efficient keypoint detection. Moreover, we use a spatio-temporal nearest-neighbor search strategy for robust keypoint tracking. Extensive experiments are conducted on a new dataset featuring both image frames and event data captured under extreme conditions. The experimental results confirm the superior performance of our method over both existing frame-based and event-based methods.


title: Finite nuclear mass correction to the hyperfine splitting in hydrogenic systems

abstract: A general quantum electrodynamic method for derivation of nuclear recoil corrections in hydrogenic systems, which are exact in the nuclear charge parameter $Z\,\alpha$, is introduced. The exemplary derivation is presented for the $O(m/M)$ nuclear pure recoil correction to the hyperfine splitting. The obtained result is verified by comparison to the known $(Z\,\alpha)^5$ contribution


title: Calibration-Based ALE Model Order Reduction for Hyperbolic Problems with Self-Similar Travelling Discontinuities

abstract: We propose a novel Model Order Reduction framework that is able to handle solutions of hyperbolic problems characterized by multiple travelling discontinuities. By means of an optimization based approach, we introduce suitable calibration maps that allow us to transform the original solution manifold into a lower dimensional one. The optimization process does not require the knowledge of the discontinuities location. In the online phase, the coefficients of the projection of the reduced order solution onto the reduced space are recovered by means of an Artificial Neural Network. To validate the methodology, we present numerical results for the 1D Sod shock tube problem and for the 2D double Mach reflection problem, also in the parametric case.


title: Normalized Validity Scores for DNNs in Regression based Eye Feature Extraction

abstract: We propose an improvement to the landmark validity loss. Landmark detection is widely used in head pose estimation, eyelid shape extraction, as well as pupil and iris segmentation. There are numerous additional applications where landmark detection is used to estimate the shape of complex objects. One part of this process is the accurate and fine-grained detection of the shape. The other part is the validity or inaccuracy per landmark, which can be used to detect unreliable areas, where the shape possibly does not fit, and to improve the accuracy of the entire shape extraction by excluding inaccurate landmarks. We propose a normalization in the loss formulation, which improves the accuracy of the entire approach due to the numerical balance of the normalized inaccuracy. In addition, we propose a margin for the inaccuracy to reduce the impact of gradients, which are produced by negligible errors close to the ground truth.


title: Skyrmion on Magnetic Tunnel Junction: Interweaving Quantum Transport with Micro-magnetism

abstract: Over the last two decades, non-trivial magnetic textures, especially the magnetic skyrmion family, have been extensively explored out of fundamental interest, and diverse possible applications. Given the possible technological and scientific ramifications of skyrmion-texture on magnetic tunnel junction (ST-MTJ), in this work, we present non-equilibrium Green's function (NEGF) based description of ST-MTJs both for N\'eel and Bloch textures, to capture the spin/charge current across different voltages, temperatures, and sizes. We predict the emergence of a textured spin current from the uniform layer of the ST-MTJs, along with a radially varying, asymmetrical voltage dependence of spin torque. We delineate the voltage-induced rotation of the spin current texture, coupled with the appearance of helicity in spin current, particularly in the case of N\'eel skyrmions on MTJs. We describe the TMR roll-off in ST-MTJ with lower cross-sectional area and higher temperature based on transmission spectra analysis. We also introduce a computationally efficient coupled spatio-eigen framework of NEGF to address the 3D-NEGF requirement of the ST-MTJs. With analytical underpinning, we establish the generic nature of the spatio-eigen framework of NEGF, alleviating the sine-qua-non of the 3D-NEGF for systems that lack transnational invariance and simultaneous eigen-basis in the transverse directions.


title: Binary Noise for Binary Tasks: Masked Bernoulli Diffusion for Unsupervised Anomaly Detection

abstract: The high performance of denoising diffusion models for image generation has paved the way for their application in unsupervised medical anomaly detection. As diffusion-based methods require a lot of GPU memory and have long sampling times, we present a novel and fast unsupervised anomaly detection approach based on latent Bernoulli diffusion models. We first apply an autoencoder to compress the input images into a binary latent representation. Next, a diffusion model that follows a Bernoulli noise schedule is employed to this latent space and trained to restore binary latent representations from perturbed ones. The binary nature of this diffusion model allows us to identify entries in the latent space that have a high probability of flipping their binary code during the denoising process, which indicates out-of-distribution data. We propose a masking algorithm based on these probabilities, which improves the anomaly detection scores. We achieve state-of-the-art performance compared to other diffusion-based unsupervised anomaly detection algorithms while significantly reducing sampling time and memory consumption. The code is available at https://github.com/JuliaWolleb/Anomaly_berdiff.


title: Mechanical effects of carboxymethylcellulose binder in hard carbon electrodes

abstract: Electrodes in sodium-ion batteries endure mechanical stress during production and application, which can damage these fragile coatings, causing performance inefficiencies and early failure. Binder material provides elasticity in electrode composites to resist fracture, but evaluating the effectiveness of binder is complicated by substrate dependency of these films, while conventional cell tests are beset by multiple electrochemical variables. This work introduces a practical low-cost indentation test to determine the elasticity of hard carbon electrodes containing standard carboxymethylcellulose binder. Using the proposed method, relative elastic moduli of hard carbon electrodes were found to be 0.079 GPa (1% binder), 0.088 GPa (2% binder), 0.105 GPa (3% binder) and 0.113 GPa (4% binder), which were validated using a computational model of film deflection to predict mechanical deformation under stress. Effects on the electrochemical performance of hard carbon anodes were also demonstrated with impedance spectroscopy and galvanostatic cycling of sodium half-cells, revealing 8-9% higher capacity retention of anodes with 4% binder compared with those containing 1% binder. These findings suggest binder content in hard carbon electrodes should be selected according to requirements for both cycle life and film flexibility during cell manufacturing.


title: Semantic Data Representation for Explainable Windows Malware Detection Models

abstract: Ontologies are a standard tool for creating semantic schemata in many knowledge intensive domains of human interest. They are becoming increasingly important also in the areas that have been until very recently dominated by subsymbolic knowledge representation and machine-learning (ML) based data processing. One such area is information security, and specifically, malware detection. We thus propose PE Malware Ontology that offers a reusable semantic schema for Portable Executable (PE - the Windows binary format) malware files. This ontology is inspired by the structure of the EMBER dataset, which focuses on the static malware analysis of PE files. With this proposal, we hope to provide a unified semantic representation for the existing and future PE-malware datasets and facilitate the application of symbolic, neuro-symbolic, or otherwise explainable approaches in the PE-malware-detection domain, which may produce interpretable results described by the terms defined in our ontology. In addition, we also publish semantically treated EMBER data, including fractional datasets, to support the reproducibility of experiments on EMBER. We supplement our work with a preliminary case study, conducted using concept learning, to show the general feasibility of our approach. While we were not able to match the precision of the state-of-the-art ML tools, the learned malware discriminators were interesting and highly interpretable.


title: Advancing Quantum Software Engineering: A Vision of Hybrid Full-Stack Iterative Model

abstract: This paper introduces a vision for Quantum Software Development lifecycle, proposing a hybrid full-stack iterative model that integrates quantum and classical computing. Addressing the current challenges in Quantum Computing (QC) such as the need for integrating diverse programming languages and managing the complexities of quantum-classical systems, this model is rooted in the principles of DevOps and continuous software engineering. It presents a comprehensive lifecycle for quantum software development, encompassing quantum-agnostic coding, testing, deployment, cloud computing services, orchestration, translation, execution, and interpretation phases. Each phase is designed to accommodate the unique demands of QC, enabling traditional software developers to engage with QC environments without needing in-depth QC expertise. The paper presents a detailed implementation roadmap, utilizing a range of existing tools and frameworks, thereby making quantum software development more accessible and efficient. The proposed model not only addresses current challenges in quantum software development but also makes a substantial contribution to the field of Quantum Software Engineering (QSE). By proposing a structured and accessible model, it sets the stage for further advancements and research in QSE, enhancing its practicality and relevance in a wide range of applications.


title: HDLdebugger: Streamlining HDL debugging with Large Language Models

abstract: In the domain of chip design, Hardware Description Languages (HDLs) play a pivotal role. However, due to the complex syntax of HDLs and the limited availability of online resources, debugging HDL codes remains a difficult and time-intensive task, even for seasoned engineers. Consequently, there is a pressing need to develop automated HDL code debugging models, which can alleviate the burden on hardware engineers. Despite the strong capabilities of Large Language Models (LLMs) in generating, completing, and debugging software code, their utilization in the specialized field of HDL debugging has been limited and, to date, has not yielded satisfactory results. In this paper, we propose an LLM-assisted HDL debugging framework, namely HDLdebugger, which consists of HDL debugging data generation via a reverse engineering approach, a search engine for retrieval-augmented generation, and a retrieval-augmented LLM fine-tuning approach. Through the integration of these components, HDLdebugger can automate and streamline HDL debugging for chip design. Our comprehensive experiments, conducted on an HDL code dataset sourced from Huawei, reveal that HDLdebugger outperforms 13 cutting-edge LLM baselines, displaying exceptional effectiveness in HDL code debugging.


title: WIA-LD2ND: Wavelet-based Image Alignment for Self-supervised Low-Dose CT Denoising

abstract: In clinical examinations and diagnoses, low-dose computed tomography (LDCT) is crucial for minimizing health risks compared with normal-dose computed tomography (NDCT). However, reducing the radiation dose compromises the signal-to-noise ratio, leading to degraded quality of CT images. To address this, we analyze LDCT denoising task based on experimental results from the frequency perspective, and then introduce a novel self-supervised CT image denoising method called WIA-LD2ND, only using NDCT data. The proposed WIA-LD2ND comprises two modules: Wavelet-based Image Alignment (WIA) and Frequency-Aware Multi-scale Loss (FAM). First, WIA is introduced to align NDCT with LDCT by mainly adding noise to the high-frequency components, which is the main difference between LDCT and NDCT. Second, to better capture high-frequency components and detailed information, Frequency-Aware Multi-scale Loss (FAM) is proposed by effectively utilizing multi-scale feature space. Extensive experiments on two public LDCT denoising datasets demonstrate that our WIA-LD2ND, only uses NDCT, outperforms existing several state-of-the-art weakly-supervised and self-supervised methods.


title: Retrieval of photon statistics from click detection

abstract: We utilize click-counting theory for the reconstruction of photon statistics. Our approach employs an analytic pseudo-inversion method to estimate photon counts from measured click counts. A reconfigurable time-bin multiplexing, click-counting detector is set up that renders it possible to alter the photon-number resolution as needed. A detector tomography is carried out, yielding vital measurement features, such as quantum efficiencies, cross-talk rates, etc. We gauge the success of the pseudo-inversion by applying the Mandel and binomial parameters, resulting in an additional interpretation of these parameters for the discrimination of distinct quantum statistics. In addition, we apply a loss deconvolution technique to account for detection losses.


title: Towards Generalizing to Unseen Domains with Few Labels

abstract: We approach the challenge of addressing semi-supervised domain generalization (SSDG). Specifically, our aim is to obtain a model that learns domain-generalizable features by leveraging a limited subset of labelled data alongside a substantially larger pool of unlabeled data. Existing domain generalization (DG) methods which are unable to exploit unlabeled data perform poorly compared to semi-supervised learning (SSL) methods under SSDG setting. Nevertheless, SSL methods have considerable room for performance improvement when compared to fully-supervised DG training. To tackle this underexplored, yet highly practical problem of SSDG, we make the following core contributions. First, we propose a feature-based conformity technique that matches the posterior distributions from the feature space with the pseudo-label from the model's output space. Second, we develop a semantics alignment loss to learn semantically-compatible representations by regularizing the semantic structure in the feature space. Our method is plug-and-play and can be readily integrated with different SSL-based SSDG baselines without introducing any additional parameters. Extensive experimental results across five challenging DG benchmarks with four strong SSL baselines suggest that our method provides consistent and notable gains in two different SSDG settings.


title: Better (pseudo-)labels for semi-supervised instance segmentation

abstract: Despite the availability of large datasets for tasks like image classification and image-text alignment, labeled data for more complex recognition tasks, such as detection and segmentation, is less abundant. In particular, for instance segmentation annotations are time-consuming to produce, and the distribution of instances is often highly skewed across classes. While semi-supervised teacher-student distillation methods show promise in leveraging vast amounts of unlabeled data, they suffer from miscalibration, resulting in overconfidence in frequently represented classes and underconfidence in rarer ones. Additionally, these methods encounter difficulties in efficiently learning from a limited set of examples. We introduce a dual-strategy to enhance the teacher model's training process, substantially improving the performance on few-shot learning. Secondly, we propose a calibration correction mechanism that that enables the student model to correct the teacher's calibration errors. Using our approach, we observed marked improvements over a state-of-the-art supervised baseline performance on the LVIS dataset, with an increase of 2.8% in average precision (AP) and 10.3% gain in AP for rare classes.


title: Prismatic crystals and $q$-Higgs fields

abstract: Similarly to the theory of crystalline cohomology, we give a local description of a prismatic crystal and its cohomology in terms of a $q$-Higgs module and the associated $q$-Higgs complex on the bounded prismatic envelope of an embedding into a framed smooth algebra, when the base bounded prism is defined over the $q$-crystalline prism. We also discuss its behavior under the scalar extension by the Frobenius lifting and tensor products, and a global description of the cohomology of a prismatic crystal via Zariski cohomological descent.


title: Narrow absorption lines from intervening material in supernovae I. Measurements and temporal evolution

abstract: Narrow absorption features in nearby supernova (SN) spectra are a powerful diagnostic of the slow-moving material in the line of sight: they are extensively used to infer dust extinction from the host galaxies, and they can also serve in the detection of circumstellar material originating from the SN progenitor and present in the vicinity of the explosion. Despite their wide use, very few studies have examined the biases of the methods to characterize narrow lines, and not many statistical analyses exist. This is the first paper of a series in which we present a statistical analysis of narrow lines of SN spectra of various resolutions. We develop a robust automated methodology to measure the equivalent width (EW) and velocity of narrow absorption lines from intervening material in the line of sight of SNe, including Na I D , Ca II H&K, K i and diffuse interstellar bands (DIBs). We carefully study systematic biases in heterogeneous spectra from the literature by simulating different signal-to-noise, spectral resolution, slit size and orientation and present the real capabilities and limitations of using low- and mid-resolution spectra to study these lines. In particular, we find that the measurement of the equivalent width of the narrow lines in low-resolution spectra is highly affected by the evolving broad P-Cygni profiles of the SN ejecta, both for core-collapse and type Ia SNe, inducing a conspicuous apparent evolution. We present thus an easy way to detect and exclude those cases to obtain more robust and reliable measurements. Finally, after considering all possible effects, we analyse the temporal evolution of the narrow features in a large sample of nearby SNe to detect any possible variation in their EWs over time. We find no time evolution of the narrow line features in our large sample for all SN types


title: Exploring 3D-aware Latent Spaces for Efficiently Learning Numerous Scenes

abstract: We present a method enabling the scaling of NeRFs to learn a large number of semantically-similar scenes. We combine two techniques to improve the required training time and memory cost per scene. First, we learn a 3D-aware latent space in which we train Tri-Plane scene representations, hence reducing the resolution at which scenes are learned. Moreover, we present a way to share common information across scenes, hence allowing for a reduction of model complexity to learn a particular scene. Our method reduces effective per-scene memory costs by 44% and per-scene time costs by 86% when training 1000 scenes. Our project page can be found at https://3da-ae.github.io .


title: NEDS-SLAM: A Novel Neural Explicit Dense Semantic SLAM Framework using 3D Gaussian Splatting

abstract: We propose NEDS-SLAM, an Explicit Dense semantic SLAM system based on 3D Gaussian representation, that enables robust 3D semantic mapping, accurate camera tracking, and high-quality rendering in real-time. In the system, we propose a Spatially Consistent Feature Fusion model to reduce the effect of erroneous estimates from pre-trained segmentation head on semantic reconstruction, achieving robust 3D semantic Gaussian mapping. Additionally, we employ a lightweight encoder-decoder to compress the high-dimensional semantic features into a compact 3D Gaussian representation, mitigating the burden of excessive memory consumption. Furthermore, we leverage the advantage of 3D Gaussian splatting, which enables efficient and differentiable novel view rendering, and propose a Virtual Camera View Pruning method to eliminate outlier GS points, thereby effectively enhancing the quality of scene representations. Our NEDS-SLAM method demonstrates competitive performance over existing dense semantic SLAM methods in terms of mapping and tracking accuracy on Replica and ScanNet datasets, while also showing excellent capabilities in 3D dense semantic mapping.


title: Multiscale Orientation Values for Biodiversity, Climate and Water: A Scientific Input for Science- Based Targets

abstract: In this study, we explore a range of options and outcomes associated with using different allocation approaches to operationalise the Planetary Boundaries (PB) framework at the country, sector, and city scales. We demonstrate: (i) how to translate the PB framework into various sub-global scales (countries, cities, industries); and (ii) how to take global/local aspects (e.g., water use at the watershed level) into account. Finally, we apply the proposed methodology to derive country, city, and sector-specific budgets consistent with the PB concept for Switzerland. We then benchmark the translated PBs for climate, biodiversity, and freshwater use against actual environmental pressures in Switzerland from both production- and consumption-based perspectives. This effectively enables us to provide a comprehensive assessment of whether Switzerland is living within its safe operating space.


title: MASSTAR: A Multi-Modal and Large-Scale Scene Dataset with a Versatile Toolchain for Surface Prediction and Completion

abstract: Surface prediction and completion have been widely studied in various applications. Recently, research in surface completion has evolved from small objects to complex large-scale scenes. As a result, researchers have begun increasing the volume of data and leveraging a greater variety of data modalities including rendered RGB images, descriptive texts, depth images, etc, to enhance algorithm performance. However, existing datasets suffer from a deficiency in the amounts of scene-level models along with the corresponding multi-modal information. Therefore, a method to scale the datasets and generate multi-modal information in them efficiently is essential. To bridge this research gap, we propose MASSTAR: a Multi-modal lArge-scale Scene dataset with a verSatile Toolchain for surfAce pRediction and completion. We develop a versatile and efficient toolchain for processing the raw 3D data from the environments. It screens out a set of fine-grained scene models and generates the corresponding multi-modal data. Utilizing the toolchain, we then generate an example dataset composed of over a thousand scene-level models with partial real-world data added. We compare MASSTAR with the existing datasets, which validates its superiority: the ability to efficiently extract high-quality models from complex scenarios to expand the dataset. Additionally, several representative surface completion algorithms are benchmarked on MASSTAR, which reveals that existing algorithms can hardly deal with scene-level completion. We will release the source code of our toolchain and the dataset. For more details, please see our project page at https://sysu-star.github.io/MASSTAR.


title: An in-depth analysis of the variable cyclotron lines in GX 301$-$2

abstract: Context. The High-Mass X-ray Binary (HMXB) system GX 301$-$2 is a persistent source with a well-known variable cyclotron line centered at 35 keV. Recently, a second cyclotron line at 50 keV has been reported with a presumably different behavior than the 35 keV line. Aims. We investigate the presence of the newly discovered cyclotron line in the phase-averaged and phase-resolved spectra at higher luminosities than before. We further aim to determine the pulse-phase variability of both lines. Methods. We analyze a NuSTAR observation of GX 301$-$2 covering the pre-periastron flare, where the source luminosity reached its peak of ${\sim} 4 \times 10^{37}\,\mathrm{erg}\,\mathrm{s}^{-1}$ in the 5-50 keV range. We analyze the phase-averaged spectra in the NuSTAR energy range from 3.5-79 keV for both the complete observation and three time segments of it. We further analyze the phase-resolved spectra and the pulse-phase variability of continuum and cyclotron line parameters. Results. We confirm that the description of the phase-averaged spectrum requires a second absorption feature at $51.5^{+1.1}_{-1.0}$ keV besides the established line at 35 keV. The statistical significance of this feature in the phase-averaged spectrum is $>99.999\%$. We further find that the 50 keV cyclotron line is present in three of eight phase bins. Conclusions. Based on the results of our analysis, we confirm that the detected absorption feature is very likely to be a cyclotron line. We discuss a variety of physical scenarios which could explain the proposed anharmonicity, but also outline circumstances under which the lines are harmonically related. We further present the cyclotron line history of GX 301$-$2 and evaluate concordance among each other. We also discuss an alternative spectral model including cyclotron line emission wings.


title: Hubble tension in a nonminimally coupled curvature-matter gravity model

abstract: The presently open problem of the Hubble tension is shown to be removed in the context of a modified theory of gravity with a non-minimal coupling between curvature and matter. By evolving the cosmological parameters that match the cosmic microwave background data until their values from direct late-time measurements, we obtain an agreement between different experimental methods without disrupting their individual validity. These modified gravity models are shown to provide adequate fits for other observational data from recent astrophysical surveys and to reproduce the late-time accelerated expansion of the Universe without the inclusion of a cosmological constant. This compatibility with observations presents further evidence of the versatility of these models in mimicking diverse cosmological phenomena in a unified manner.


title: Primal-dual interior-point algorithm for linearly constrained convex optimization based on a parametric algebraic transformation

abstract: In this paper, we present an interior point algorithm with a full-Newton step for solving a linearly constrained convex optimization problem, in which we propose a generalization of the work of Kheirfam and Nasrollahi \cite{kheirfam2018full}, that consists in determining the descent directions through a parametric algebraic transformation. The work concludes with a complete study of the convergence of the algorithm and its complexity, where we show that the obtained algorithm achieves a polynomial complexity bounds.


title: Berezinskii-Kosterlitz-Thouless to BCS-like superconducting transition crossover driven by weak magnetic fields in ultra-thin NbN films

abstract: The Berezinskii-Kosterlitz-Thouless (BKT) transition in ultra-thin NbN films is investigated in the presence of weak perpendicular magnetic fields. A jump in the phase stiffness at the BKT transition is detected up to 5 G, while the BKT features are smeared between 5 G and 50 G, disappearing altogether at 100 G, where conventional current-voltage behaviour is observed. Our findings demonstrate that weak magnetic fields, insignificant in bulk systems, deeply affect our ultra-thin system, promoting a crossover from Halperin-Nelson fluctuations to a BCS-like state with Ginzburg-Landau fluctuations, as the field increases. This behavior is related to field-induced free vortices that screen the vortex-antivortex interaction and smear the BKT transition.


title: Crystalformer: Infinitely Connected Attention for Periodic Structure Encoding

abstract: Predicting physical properties of materials from their crystal structures is a fundamental problem in materials science. In peripheral areas such as the prediction of molecular properties, fully connected attention networks have been shown to be successful. However, unlike these finite atom arrangements, crystal structures are infinitely repeating, periodic arrangements of atoms, whose fully connected attention results in infinitely connected attention. In this work, we show that this infinitely connected attention can lead to a computationally tractable formulation, interpreted as neural potential summation, that performs infinite interatomic potential summations in a deeply learned feature space. We then propose a simple yet effective Transformer-based encoder architecture for crystal structures called Crystalformer. Compared to an existing Transformer-based model, the proposed model requires only 29.4% of the number of parameters, with minimal modifications to the original Transformer architecture. Despite the architectural simplicity, the proposed method outperforms state-of-the-art methods for various property regression tasks on the Materials Project and JARVIS-DFT datasets.


title: Nonsmooth Implicit Differentiation: Deterministic and Stochastic Convergence Rates

abstract: We study the problem of efficiently computing the derivative of the fixed-point of a parametric nondifferentiable contraction map. This problem has wide applications in machine learning, including hyperparameter optimization, meta-learning and data poisoning attacks. We analyze two popular approaches: iterative differentiation (ITD) and approximate implicit differentiation (AID). A key challenge behind the nonsmooth setting is that the chain rule does not hold anymore. We build upon the work by Bolte et al. (2022), who prove linear convergence of nonsmooth ITD under a piecewise Lipschitz smooth assumption. In the deterministic case, we provide a linear rate for AID and an improved linear rate for ITD which closely match the ones for the smooth setting. We further introduce NSID, a new stochastic method to compute the implicit derivative when the contraction map is defined as the composition of an outer map and an inner map which is accessible only through a stochastic unbiased estimator. We establish rates for the convergence of NSID, encompassing the best available rates in the smooth setting. We also present illustrative experiments confirming our analysis.


title: Layer dependent topological phases and transitions in TaRhTe$_4$: From monolayer and bilayer to bulk

abstract: The recently synthesized ternary quasi-2D material TaRhTe$_4$ is a bulk Weyl semimetal with an intrinsically layered structure, which poses the question how the topology of its electronic structure depends on layers separations. Experimentally these separations may be changed for instance by intercalation of the bulk, or by exfoliation to reach monolayer or few-layer structures. Here we show that in the monolayer limit a quantum spin Hall insulator (QSHI) state emerges, employing density functional calculations as well as a minimal four-orbital tight-binding model that we develop. Even for weak spin-orbit couplings the QSHI is present, which has an interesting edge state that features Rashba-split bands with quadratic band minima. Further we find that a weak topological insulator (WTI) manifests in the bilayer system due to sizable intralayer hopping, contrary to the common lore that only weak interlayer interactions between stacked QSHIs lead to WTIs. Stacked bilayers give rise to a phase diagram as function of the interlayer separation that comprises a Weyl semimetal, WTI and normal insulator phases. These insights on the evolution of topology with dimension can be transferred to the family of layered ternary transition metal tellurides.


title: MoreStyle: Relax Low-frequency Constraint of Fourier-based Image Reconstruction in Generalizable Medical Image Segmentation

abstract: The task of single-source domain generalization (SDG) in medical image segmentation is crucial due to frequent domain shifts in clinical image datasets. To address the challenge of poor generalization across different domains, we introduce a Plug-and-Play module for data augmentation called MoreStyle. MoreStyle diversifies image styles by relaxing low-frequency constraints in Fourier space, guiding the image reconstruction network. With the help of adversarial learning, MoreStyle further expands the style range and pinpoints the most intricate style combinations within latent features. To handle significant style variations, we introduce an uncertainty-weighted loss. This loss emphasizes hard-to-classify pixels resulting only from style shifts while mitigating true hard-to-classify pixels in both MoreStyle-generated and original images. Extensive experiments on two widely used benchmarks demonstrate that the proposed MoreStyle effectively helps to achieve good domain generalization ability, and has the potential to further boost the performance of some state-of-the-art SDG methods.


title: An extension operator for manifold-valued Sobolev maps on perforated domains

abstract: Motivated by manifold-constrained homogenization problems, we construct a scale-independent extension operator for Sobolev functions defined on a perforated domain and taking values in a compact connected Riemannian manifold without boundary. The proof carefully combines the prominent extension result by Acerbi et al., with a retraction argument which heavily relies on the topological structure of the manifold itself. With the aim of providing necessary conditions for the extendability of Sobolev maps between manifolds, we additionally investigate the relationship between this problem and the surjectivity of the trace operator for such functions.


title: TTT-KD: Test-Time Training for 3D Semantic Segmentation through Knowledge Distillation from Foundation Models

abstract: Test-Time Training (TTT) proposes to adapt a pre-trained network to changing data distributions on-the-fly. In this work, we propose the first TTT method for 3D semantic segmentation, TTT-KD, which models Knowledge Distillation (KD) from foundation models (e.g. DINOv2) as a self-supervised objective for adaptation to distribution shifts at test-time. Given access to paired image-pointcloud (2D-3D) data, we first optimize a 3D segmentation backbone for the main task of semantic segmentation using the pointclouds and the task of 2D $\to$ 3D KD by using an off-the-shelf 2D pre-trained foundation model. At test-time, our TTT-KD updates the 3D segmentation backbone for each test sample, by using the self-supervised task of knowledge distillation, before performing the final prediction. Extensive evaluations on multiple indoor and outdoor 3D segmentation benchmarks show the utility of TTT-KD, as it improves performance for both in-distribution (ID) and out-of-distribution (ODO) test datasets. We achieve a gain of up to 13% mIoU (7% on average) when the train and test distributions are similar and up to 45% (20% on average) when adapting to OOD test samples.


title: ARTEMIS emulator: exploring the effect of cosmology and galaxy formation physics on Milky Way-mass haloes and their satellites

abstract: We present the new ARTEMIS emulator suite of high resolution (baryon mass of $2.23 \times 10^{4}$ $h^{-1}$M$_{\odot}$) zoom-in simulations of Milky Way mass systems. Here, three haloes from the original ARTEMIS sample have been rerun multiple times, systematically varying parameters for the stellar feedback model, the density threshold for star formation, the reionisation redshift and the assumed warm dark matter (WDM) particle mass (assuming a thermal relic). From these simulations emulators are trained for a wide range of statistics that allow for fast predictions at combinations of parameters not originally sampled, running in $\sim 1$ms (a factor of $\sim 10^{11}$ faster than the simulations). In this paper we explore the dependence of the central haloes' stellar mass on the varied parameters, finding the stellar feedback parameters to be the most important. When constraining the parameters to match the present-day stellar mass halo mass relation inferred from abundance matching we find that there is a strong degeneracy in the stellar feedback parameters, corresponding to a freedom in formation time of the stellar component for a fixed halo assembly history. We additionally explore the dependence of the satellite stellar mass function, where it is found that variations in stellar feedback, the reionisation redshift and the WDM mass all have a significant effect. The presented emulators are a powerful tool which allows for fundamentally new ways of analysing and interpreting cosmological hydrodynamic simulations. Crucially, allowing their free (subgrid) parameters to be varied and marginalised, leading to more robust constraints and predictions.


title: Beamforming Design for Semantic-Bit Coexisting Communication System

abstract: Semantic communication (SemCom) is emerging as a key technology for future sixth-generation (6G) systems. Unlike traditional bit-level communication (BitCom), SemCom directly optimizes performance at the semantic level, leading to superior communication efficiency. Nevertheless, the task-oriented nature of SemCom renders it challenging to completely replace BitCom. Consequently, it is desired to consider a semantic-bit coexisting communication system, where a base station (BS) serves SemCom users (sem-users) and BitCom users (bit-users) simultaneously. Such a system faces severe and heterogeneous inter-user interference. In this context, this paper provides a new semantic-bit coexisting communication framework and proposes a spatial beamforming scheme to accommodate both types of users. Specifically, we consider maximizing the semantic rate for semantic users while ensuring the quality-of-service (QoS) requirements for bit-users. Due to the intractability of obtaining the exact closed-form expression of the semantic rate, a data driven method is first applied to attain an approximated expression via data fitting. With the resulting complex transcendental function, majorization minimization (MM) is adopted to convert the original formulated problem into a multiple-ratio problem, which allows fractional programming (FP) to be used to further transform the problem into an inhomogeneous quadratically constrained quadratic programs (QCQP) problem. Solving the problem leads to a semi-closed form solution with undetermined Lagrangian factors that can be updated by a fixed point algorithm. Extensive simulation results demonstrate that the proposed beamforming scheme significantly outperforms conventional beamforming algorithms such as zero-forcing (ZF), maximum ratio transmission (MRT), and weighted minimum mean-square error (WMMSE).


title: Object Segmentation-Assisted Inter Prediction for Versatile Video Coding

abstract: In modern video coding standards, block-based inter prediction is widely adopted, which brings high compression efficiency. However, in natural videos, there are usually multiple moving objects of arbitrary shapes, resulting in complex motion fields that are difficult to compactly represent. This problem has been tackled by more flexible block partitioning methods in the Versatile Video Coding (VVC) standard, but the more flexible partitions require more overhead bits to signal and still cannot be made arbitrary shaped. To address this limitation, we propose an object segmentation-assisted inter prediction method (SAIP), where objects in the reference frames are segmented by some advanced technologies. With a proper indication, the object segmentation mask is translated from the reference frame to the current frame as the arbitrary-shaped partition of different regions without any extra signal. Using the segmentation mask, motion compensation is separately performed for different regions, achieving higher prediction accuracy. The segmentation mask is further used to code the motion vectors of different regions more efficiently. Moreover, segmentation mask is considered in the joint rate-distortion optimization for motion estimation and partition estimation to derive the motion vector of different regions and partition more accurately. The proposed method is implemented into the VVC reference software, VTM version 12.0. Experimental results show that the proposed method achieves up to 1.98%, 1.14%, 0.79%, and on average 0.82%, 0.49%, 0.37% BD-rate reduction for common test sequences, under the Low-delay P, Low-delay B, and Random Access configurations, respectively.


title: TrajectoryNAS: A Neural Architecture Search for Trajectory Prediction

abstract: Autonomous driving systems are a rapidly evolving technology that enables driverless car production. Trajectory prediction is a critical component of autonomous driving systems, enabling cars to anticipate the movements of surrounding objects for safe navigation. Trajectory prediction using Lidar point-cloud data performs better than 2D images due to providing 3D information. However, processing point-cloud data is more complicated and time-consuming than 2D images. Hence, state-of-the-art 3D trajectory predictions using point-cloud data suffer from slow and erroneous predictions. This paper introduces TrajectoryNAS, a pioneering method that focuses on utilizing point cloud data for trajectory prediction. By leveraging Neural Architecture Search (NAS), TrajectoryNAS automates the design of trajectory prediction models, encompassing object detection, tracking, and forecasting in a cohesive manner. This approach not only addresses the complex interdependencies among these tasks but also emphasizes the importance of accuracy and efficiency in trajectory modeling. Through empirical studies, TrajectoryNAS demonstrates its effectiveness in enhancing the performance of autonomous driving systems, marking a significant advancement in the field.Experimental results reveal that TrajcetoryNAS yield a minimum of 4.8 higger accuracy and 1.1* lower latency over competing methods on the NuScenes dataset.


title: Generalization error of spectral algorithms

abstract: The asymptotically precise estimation of the generalization of kernel methods has recently received attention due to the parallels between neural networks and their associated kernels. However, prior works derive such estimates for training by kernel ridge regression (KRR), whereas neural networks are typically trained with gradient descent (GD). In the present work, we consider the training of kernels with a family of $\textit{spectral algorithms}$ specified by profile $h(\lambda)$, and including KRR and GD as special cases. Then, we derive the generalization error as a functional of learning profile $h(\lambda)$ for two data models: high-dimensional Gaussian and low-dimensional translation-invariant model. Under power-law assumptions on the spectrum of the kernel and target, we use our framework to (i) give full loss asymptotics for both noisy and noiseless observations (ii) show that the loss localizes on certain spectral scales, giving a new perspective on the KRR saturation phenomenon (iii) conjecture, and demonstrate for the considered data models, the universality of the loss w.r.t. non-spectral details of the problem, but only in case of noisy observation.


title: Urban Scene Diffusion through Semantic Occupancy Map

abstract: Generating unbounded 3D scenes is crucial for large-scale scene understanding and simulation. Urban scenes, unlike natural landscapes, consist of various complex man-made objects and structures such as roads, traffic signs, vehicles, and buildings. To create a realistic and detailed urban scene, it is crucial to accurately represent the geometry and semantics of the underlying objects, going beyond their visual appearance. In this work, we propose UrbanDiffusion, a 3D diffusion model that is conditioned on a Bird's-Eye View (BEV) map and generates an urban scene with geometry and semantics in the form of semantic occupancy map. Our model introduces a novel paradigm that learns the data distribution of scene-level structures within a latent space and further enables the expansion of the synthesized scene into an arbitrary scale. After training on real-world driving datasets, our model can generate a wide range of diverse urban scenes given the BEV maps from the held-out set and also generalize to the synthesized maps from a driving simulator. We further demonstrate its application to scene image synthesis with a pretrained image generator as a prior.


title: Spin-Orbital Ordering in Alkali Superoxides

abstract: Akali superoxides AO2 (A=Na, K, Rb, Cs), due to an open p shell of the oxygen ion O2^- with degenerate pi orbitals, have spin and orbital degrees of freedom. The complex magnetic, orbital, and structural phase transitions observed experimentally in this family of materials are only partially understood. Based on density functional theory, we derive a strong-coupling effective model for the isostructural compounds AO2 (A=K, Rb, Cs) from a two-orbital Hubbard model. We find that CsO2 has highly frustrated exchange interactions in the a-b plane, while the frustration is weaker for RbO2 and KO2. We solve the resulting Kugel-Khomskii model in the mean-field approximation. We show that CsO2 exhibits an antiferro-orbital (AFO) order with the ordering vector q=(1,0,0) and a stripe antiferromagnetic order with q=(1/2,0,0), which is consistent with recent neutron scattering experiments. We discuss the role of the pi-orbital degrees of freedom for the experimentally observed magnetic transitions and interpret the as-yet-unidentified T_s2=70K transition in CsO2 as an orbital ordering transition.


title: A Spatial-Temporal Progressive Fusion Network for Breast Lesion Segmentation in Ultrasound Videos

abstract: Ultrasound video-based breast lesion segmentation provides a valuable assistance in early breast lesion detection and treatment. However, existing works mainly focus on lesion segmentation based on ultrasound breast images which usually can not be adapted well to obtain desirable results on ultrasound videos. The main challenge for ultrasound video-based breast lesion segmentation is how to exploit the lesion cues of both intra-frame and inter-frame simultaneously. To address this problem, we propose a novel Spatial-Temporal Progressive Fusion Network (STPFNet) for video based breast lesion segmentation problem. The main aspects of the proposed STPFNet are threefold. First, we propose to adopt a unified network architecture to capture both spatial dependences within each ultrasound frame and temporal correlations between different frames together for ultrasound data representation. Second, we propose a new fusion module, termed Multi-Scale Feature Fusion (MSFF), to fuse spatial and temporal cues together for lesion detection. MSFF can help to determine the boundary contour of lesion region to overcome the issue of lesion boundary blurring. Third, we propose to exploit the segmentation result of previous frame as the prior knowledge to suppress the noisy background and learn more robust representation. In particular, we introduce a new publicly available ultrasound video breast lesion segmentation dataset, termed UVBLS200, which is specifically dedicated to breast lesion segmentation. It contains 200 videos, including 80 videos of benign lesions and 120 videos of malignant lesions. Experiments on the proposed dataset demonstrate that the proposed STPFNet achieves better breast lesion detection performance than state-of-the-art methods.


title: Virbo: Multimodal Multilingual Avatar Video Generation in Digital Marketing

abstract: With the widespread popularity of internet celebrity marketing all over the world, short video production has gradually become a popular way of presenting products information. However, the traditional video production industry usually includes series of procedures as script writing, video filming in a professional studio, video clipping, special effects rendering, customized post-processing, and so forth. Not to mention that multilingual videos is not accessible for those who could not speak multilingual languages. These complicated procedures usually needs a professional team to complete, and this made short video production costly in both time and money. This paper presents an intelligent system that supports the automatic generation of talking avatar videos, namely Virbo. With simply a user-specified script, Virbo could use a deep generative model to generate a target talking videos. Meanwhile, the system also supports multimodal inputs to customize the video with specified face, specified voice and special effects. This system also integrated a multilingual customization module that supports generate multilingual talking avatar videos in a batch with hundreds of delicate templates and creative special effects. Through a series of user studies and demo tests, we found that Virbo can generate talking avatar videos that maintained a high quality of videos as those from a professional team while reducing the entire production costs significantly. This intelligent system will effectively promote the video production industry and facilitate the internet marketing neglecting of language barriers and cost challenges.


title: Memory formation in dense persistent active matter

abstract: Protocol-dependent states in structural glasses can encode a disordered, yet retrievable memory. While training such materials is typically done via a global drive, such as external shear, in dense active matter the driving is instead local and spatio-temporally correlated. Here we focus on the impact of such spatial correlation on memory formation. We investigate the mechanical response of a dense amorphous packing of athermal particles, subject to an oscillatory quasistatic driving with a tunable spatial correlation, akin to the instantaneous driving pattern in active matter. We find that the capacity to encode memory can be rendered comparable upon a proper rescaling on the spatial correlation, whereas the efficiency in memory formation increases with motion cooperativity.


title: Gravitational Form Factors and Mechanical Properties of Quarks in Protons: A Basis Light-Front Quantization Approach

abstract: We compute the gravitational form factors (GFFs) and study their applications for the description of the mechanical properties such as the pressure, shear force distributions, and the mechanical radius of the proton from its light-front wave functions (LFWFs) based on basis light-front quantization (BLFQ). The LFWFs of the proton are given by the lowest eigenvector of a light-front effective Hamiltonian that incorporates a three-dimensional confining potential and a one-gluon exchange interaction with fixed coupling between the constituent quarks solved in the valence Fock sector. We find acceptable agreement between our BLFQ computations and the lattice QCD for the GFFs. Our $D$-term form factor also agrees well with the extracted data from the deeply virtual Compton scattering experiments at Jefferson Lab, and the results of different phenomenological models. The distributions of pressures and shear forces are similar to those from different models.


title: LLaVA-UHD: an LMM Perceiving Any Aspect Ratio and High-Resolution Images

abstract: Visual encoding constitutes the basis of large multimodal models (LMMs) in understanding the visual world. Conventional LMMs process images in fixed sizes and limited resolutions, while recent explorations in this direction are limited in adaptivity, efficiency, and even correctness. In this work, we first take GPT-4V and LLaVA-1.5 as representative examples and expose systematic flaws rooted in their visual encoding strategy. To address the challenges, we present LLaVA-UHD, a large multimodal model that can efficiently perceive images in any aspect ratio and high resolution. LLaVA-UHD includes three key components: (1) An image modularization strategy that divides native-resolution images into smaller variable-sized slices for efficient and extensible encoding, (2) a compression module that further condenses image tokens from visual encoders, and (3) a spatial schema to organize slice tokens for LLMs. Comprehensive experiments show that LLaVA-UHD outperforms established LMMs trained with 2-3 orders of magnitude more data on 9 benchmarks. Notably, our model built on LLaVA-1.5 336x336 supports 6 times larger (i.e., 672x1088) resolution images using only 94% inference computation, and achieves 6.4 accuracy improvement on TextVQA. Moreover, the model can be efficiently trained in academic settings, within 23 hours on 8 A100 GPUs (vs. 26 hours of LLaVA-1.5). We make the data and code publicly available at https://github.com/thunlp/LLaVA-UHD.