title: Instance Tracking in 3D Scenes from Egocentric Videos

abstract: Egocentric sensors such as AR/VR devices capture human-object interactions and offer the potential to provide task-assistance by recalling 3D locations of objects of interest in the surrounding environment. This capability requires instance tracking in real-world 3D scenes from egocentric videos (IT3DEgo). We explore this problem by first introducing a new benchmark dataset, consisting of RGB and depth videos, per-frame camera pose, and instance-level annotations in both 2D camera and 3D world coordinates. We present an evaluation protocol which evaluates tracking performance in 3D coordinates with two settings for enrolling instances to track: (1) single-view online enrollment where an instance is specified on-the-fly based on the human wearer's interactions. and (2) multi-view pre-enrollment where images of an instance to be tracked are stored in memory ahead of time. To address IT3DEgo, we first re-purpose methods from relevant areas, e.g., single object tracking (SOT) -- running SOT methods to track instances in 2D frames and lifting them to 3D using camera pose and depth. We also present a simple method that leverages pretrained segmentation and detection models to generate proposals from RGB frames and match proposals with enrolled instance images. Our experiments show that our method (with no finetuning) significantly outperforms SOT-based approaches in the egocentric setting. We conclude by arguing that the problem of egocentric instance tracking is made easier by leveraging camera pose and using a 3D allocentric (world) coordinate representation.


title: Caregiver Talk Shapes Toddler Vision: A Computational Study of Dyadic Play

abstract: Infants' ability to recognize and categorize objects develops gradually. The second year of life is marked by both the emergence of more semantic visual representations and a better understanding of word meaning. This suggests that language input may play an important role in shaping visual representations. However, even in suitable contexts for word learning like dyadic play sessions, caregivers utterances are sparse and ambiguous, often referring to objects that are different from the one to which the child attends. Here, we systematically investigate to what extent caregivers' utterances can nevertheless enhance visual representations. For this we propose a computational model of visual representation learning during dyadic play. We introduce a synthetic dataset of ego-centric images perceived by a toddler-agent that moves and rotates toy objects in different parts of its home environment while hearing caregivers' utterances, modeled as captions. We propose to model toddlers' learning as simultaneously aligning representations for 1) close-in-time images and 2) co-occurring images and utterances. We show that utterances with statistics matching those of real caregivers give rise to representations supporting improved category recognition. Our analysis reveals that a small decrease/increase in object-relevant naming frequencies can drastically impact the learned representations. This affects the attention on object names within an utterance, which is required for efficient visuo-linguistic alignment. Overall, our results support the hypothesis that caregivers' naming utterances can improve toddlers' visual representations.


title: A brief introduction to a framework named Multilevel Guidance-Exploration Network

abstract: Human behavior anomaly detection aims to identify unusual human actions, playing a crucial role in intelligent surveillance and other areas. The current mainstream methods still adopt reconstruction or future frame prediction techniques. However, reconstructing or predicting low-level pixel features easily enables the network to achieve overly strong generalization ability, allowing anomalies to be reconstructed or predicted as effectively as normal data. Different from their methods, inspired by the Student-Teacher Network, we propose a novel framework called the Multilevel Guidance-Exploration Network(MGENet), which detects anomalies through the difference in high-level representation between the Guidance and Exploration network. Specifically, we first utilize the pre-trained Normalizing Flow that takes skeletal keypoints as input to guide an RGB encoder, which takes unmasked RGB frames as input, to explore motion latent features. Then, the RGB encoder guides the mask encoder, which takes masked RGB frames as input, to explore the latent appearance feature. Additionally, we design a Behavior-Scene Matching Module(BSMM) to detect scene-related behavioral anomalies. Extensive experiments demonstrate that our proposed method achieves state-of-the-art performance on ShanghaiTech and UBnormal datasets.


title: A conjecture of Erd\H{o}s on $p+2^k$

abstract: Let $\mathcal{U}$ be the set of positive odd integers that cannot be represented as the sum of a prime and a power of two. In this paper, we prove that $\mathcal{U}$ is not a union of finitely many infinite arithmetic progressions and a set of asymptotic density zero. This gives a negative answer to a conjecture of P. Erd\H os. We pose several problems and a conjecture for further research.


title: Cohomology and deformation theory of $\mathcal{O}$-operators on Hom-Lie conformal algebras

abstract: In the present paper, we aim to introduce the cohomology of $\mathcal{O}$-operators defined on the Hom-Lie conformal algebra concerning the given representation. To obtain the desired results, we describe three different cochain complexes and discuss the interrelation of their coboundary operators. And show that differential maps on the graded Lie algebra can also be defined by using the Maurer-Cartan element. We further find out that, the $\mathcal{O}$-operator on the given Hom-Lie conformal algebra serves as a Maurer-Cartan element and it leads to acquiring the notion of a differential map in terms of $\mathcal{O}$-operator $\delta_{\mathcal{T}}$. Next, we provide the notion of Hom-pre-Lie conformal algebra, that induces a sub-adjacent Hom-Lie conformal algebra structure. The differential $\delta_{\beta,\alpha}$ of this sub-adjacent Hom-Lie conformal algebra is related to the differential $\delta_{\mathcal{T}}$. Finally, we provide the deformation theory of $\mathcal{O}$-operators on the Hom-Lie conformal algebras as an application to the cohomology theory, where we discuss linear and formal deformations in detail.


title: First Principles Investigation on Structural and Optoelectronic Properties of newly designed Janus Lead Halides PbXY (X, Y = F, Cl, Br, I )

abstract: Here, we design a novel class of Janus structures PbXY(X,Y = F, Cl, Br, I) and propose it for the solar mediated photocatalytic water splitting hydrogen production as well as for the photovoltaic solarcell applications. Charge analysis shows that covalent bonding for less electronegative atoms and ionic bonding for more electronegative atoms. Strong dual bonding like ionic one side and covalent other side is observed when heavy and lighter atoms are part of the same Janus structures. The as designed Janus structures show good dynamical stability through phonon calculations. Basic electronic structure using Generalised Gradient Approximation(GGA) reveal both direct and indirect nature of band gap with large tunability. Heyd-Scuseria-Ernzerhof (HSE) electronic structure calculations are performed and wider band gaps are predicted for these Janus structures. The calculated effective masses of charge carriers show robust charge carrier dynamics. The orbital resolved electronic density of states (DOS) shows that the conduction band edge is composed of pz orbital of Pb atom. The partialcharge density calculated at conduction band minimum (CBM) also support the result obtained from PDOS analysis. Breaking of centrosymmetry, polarization in the out of plane direction, the z-oriented orbitals of CBM all points that these materials are suitable for shift current generation. The calculated optical absorption spectra show that the Janus structures are suitable for visible light absorption. The calculated potential difference between the top and bottom layer show significant variation and maximum (1.02 eV) is observed for PbClF. Further, we show that combining both potential difference and HSE bandgap, valence band maximum(VBM) and CBM straddle the water redox potentials, thus making the Janus structures suitable for water redox reactions.


title: Approximating the Graph Edit Distance with Compact Neighborhood Representations

abstract: The graph edit distance is used for comparing graphs in various domains. Due to its high computational complexity it is primarily approximated. Widely-used heuristics search for an optimal assignment of vertices based on the distance between local substructures. While faster ones only consider vertices and their incident edges, leading to poor accuracy, other approaches require computationally intense exact distance computations between subgraphs. Our new method abstracts local substructures to neighborhood trees and compares them using efficient tree matching techniques. This results in a ground distance for mapping vertices that yields high quality approximations of the graph edit distance. By limiting the maximum tree height, our method supports steering between more accurate results and faster execution. We thoroughly analyze the running time of the tree matching method and propose several techniques to accelerate computation in practice. We use compressed tree representations, recognize redundancies by tree canonization and exploit them via caching. Experimentally we show that our method provides a significantly improved trade-off between running time and approximation quality compared to existing state-of-the-art approaches.


title: Formal multiple Eisenstein series and their derivations

abstract: We introduce the algebra of formal multiple Eisenstein series and study its derivations. This algebra is motivated by the classical multiple Eisenstein series, introduced by Gangl-Kaneko-Zagier as a hybrid of classical Eisenstein series and multiple zeta values. In depth one, we obtain formal versions of the Eisenstein series satisfying the same algebraic relations as the classical Eisenstein series. In particular, they generate an algebra whose elements we call formal quasimodular forms. We show that the algebra of formal multiple Eisenstein series is an $\mathfrak{sl}_2$-algebra by formalizing the usual derivations for quasimodular forms and extending them naturally to the whole algebra. Additionally, we introduce some families of derivations for general quasi-shuffle algebras, providing a broader context for these derivations. Further, we prove that a quotient of this algebra is isomorphic to the algebra of formal multiple zeta values. This gives a novel and purely formal approach to classical (quasi)modular forms and builds a new link between (formal) multiple zeta values and modular forms.


title: Forensic Iris Image Synthesis

abstract: Post-mortem iris recognition is an emerging application of iris-based human identification in a forensic setup, able to correctly identify deceased subjects even three weeks post-mortem. This technique thus is considered as an important component of future forensic toolkits. The current advancements in this field are seriously slowed down by exceptionally difficult data collection, which can happen in mortuary conditions, at crime scenes, or in ``body farm'' facilities. This paper makes a novel contribution to facilitate progress in post-mortem iris recognition by offering a conditional StyleGAN-based iris synthesis model, trained on the largest-available dataset of post-mortem iris samples acquired from more than 350 subjects, generating -- through appropriate exploration of StyleGAN latent space -- multiple within-class (same identity) and between-class (different new identities) post-mortem iris images, compliant with ISO/IEC 29794-6, and with decomposition deformations controlled by the requested PMI (post mortem interval). Besides an obvious application to enhance the existing, very sparse, post-mortem iris datasets to advance -- among others -- iris presentation attack endeavors, we anticipate it may be useful to generate samples that would expose professional forensic human examiners to never-seen-before deformations for various PMIs, increasing their training effectiveness. The source codes and model weights are made available with the paper.


title: An Improved Scheduling with Advantage Actor-Critic for Storm Workloads

abstract: Various resources as the essential elements of data centers, and the completion time is vital to users. In terms of the persistence, the periodicity and the spatial-temporal dependence of stream workload, a new Storm scheduler with Advantage Actor-Critic is proposed to improve resource utilization for minimizing the completion time. A new weighted embedding with a Graph Neural Network is designed to depend on the features of a job comprehensively, which includes the dependence, the types and the positions of tasks in a job. An improved Advantage Actor-Critic integrating task chosen and executor assignment is proposed to schedule tasks to executors in order to better resource utilization. Then the status of tasks and executors are updated for the next scheduling. Compared to existing methods, experimental results show that the proposed Storm scheduler improves resource utilization. The completion time is reduced by almost 17\% on the TPC-H data set and reduced by almost 25\% on the Alibaba data set.


title: Analyzing the Inherent Response Tendency of LLMs: Real-World Instructions-Driven Jailbreak

abstract: Extensive work has been devoted to improving the safety mechanism of Large Language Models (LLMs). However, LLMs still tend to generate harmful responses when faced with malicious instructions, a phenomenon referred to as "Jailbreak Attack". In our research, we introduce a novel automatic jailbreak method RADIAL, which bypasses the security mechanism by amplifying the potential of LLMs to generate affirmation responses. The jailbreak idea of our method is "Inherent Response Tendency Analysis" which identifies real-world instructions that can inherently induce LLMs to generate affirmation responses and the corresponding jailbreak strategy is "Real-World Instructions-Driven Jailbreak" which involves strategically splicing real-world instructions identified through the above analysis around the malicious instruction. Our method achieves excellent attack performance on English malicious instructions with five open-source advanced LLMs while maintaining robust attack performance in executing cross-language attacks against Chinese malicious instructions. We conduct experiments to verify the effectiveness of our jailbreak idea and the rationality of our jailbreak strategy design. Notably, our method designed a semantically coherent attack prompt, highlighting the potential risks of LLMs. Our study provides detailed insights into jailbreak attacks, establishing a foundation for the development of safer LLMs.


title: Log continuity of solutions of complex Monge-Amp\`ere equations

abstract: Let X be a compact Kaehler manifold with semipositive anticanonical line bundle. Let L be a big and semi-ample line bundle on X and $\alpha$ be the Chern class of L. We prove that the solution of the complex Monge-Amp\`ere equations in $\alpha$ with Lp righthand side (p > 1) is $\log^M$-continuous for every constant M > 0. As an application, we show that every singular Ricci-flat metric in a semi-ample class in a projective Calabi-Yau manifold X is globally $\log^M$-continuous with respect to a smooth metric on X.


title: Nanoscale magnets embedded in a microstrip

abstract: Nanoscale magnetic resonance imaging (NanoMRI) is an active area of applied research with potential use in structural biology and quantum engineering. The success of this technological vision hinges on improving the instrument's sensitivity and functionality. A particular challenge is the optimization of the magnetic field gradient required for spatial encoding, and of the radio-frequency field used for spin control, in analogy to the components used in clinical MRI. In this work, we present the fabrication and characterization of a magnet-in-microstrip device that yields a compact form factor for both elements. We find that our design leads to a number of advantages, among them a fourfold increase of the magnetic field gradient compared to those achieved with traditional fabrication methods. Our results can be useful for boosting the efficiency of a variety of different experimental arrangements and detection principles in the field of NanoMRI.


title: The Wave Equation on Lattices and Oscillatory Integrals

abstract: In this paper, we establish sharp dispersive estimates for the linear wave equation on the lattice $\mathbb{Z}^d$ with dimension $d=4$. Combining the singularity theory with results in uniform estimates of oscillatory integrals, we prove that the optimal time decay rate of the fundamental solution is of order $|t|^{-\frac{3}{2}}\log |t|$, which is the first extension of P. Schultz's results \cite{S98} in $d=2,3$ to the higher dimension. Moreover, we notice that the Newton polyhedron can be used not only to interpret the decay rates for $d=2,3,4$, but also to study the most degenerate case for all odd $d\geq 3$. Furthermore, we prove $l^p\rightarrow l^q$ estimates as well as Strichartz estimates and give applications to nonlinear wave equations.


title: Joint Training or Not: An Exploration of Pre-trained Speech Models in Audio-Visual Speaker Diarization

abstract: The scarcity of labeled audio-visual datasets is a constraint for training superior audio-visual speaker diarization systems. To improve the performance of audio-visual speaker diarization, we leverage pre-trained supervised and self-supervised speech models for audio-visual speaker diarization. Specifically, we adopt supervised~(ResNet and ECAPA-TDNN) and self-supervised pre-trained models~(WavLM and HuBERT) as the speaker and audio embedding extractors in an end-to-end audio-visual speaker diarization~(AVSD) system. Then we explore the effectiveness of different frameworks, including Transformer, Conformer, and cross-attention mechanism, in the audio-visual decoder. To mitigate the degradation of performance caused by separate training, we jointly train the audio encoder, speaker encoder, and audio-visual decoder in the AVSD system. Experiments on the MISP dataset demonstrate that the proposed method achieves superior performance and obtained third place in MISP Challenge 2022.


title: Spin-flip gluon GTMD $F_{1,2}$ at small-$x$

abstract: Until recently the spin-flip processes in the deep inelastic scatterings are thought to be suppressed in the high energy. We found a positive intercept for the spin-flip generalized transverse momentum-dependent parton distribution (GTMDs) ${\rm Re}(F_{1,2})$ as, \begin{eqnarray} {\rm Re}(F_{1,2}) \sim \left(\frac{1}{x}\right)^{{\bar \alpha}_s\left(4\ln2-8/3\right)} \left(\cos 3\phi_{k\Delta} +\cos \phi_{k\Delta}\right). \nonumber \end{eqnarray} This is done by analytically solving the integro-differential evolution equation for ${\rm Re}(F_{1,2})$, recently proposed by Hatta and Zhou, in the dilute regime. Interestingly, the surviving solution corresponds to conformal spin $n=2$ and carries an explicit $\cos 3\phi_{k\Delta} + \cos \phi_{k\Delta}$ azimuthal dependence. As the imaginary part of $F_{1,2}$, is related to the spin-dependent odderon or gluon Siver function and scales as ${\rm Im}(F_{1,2}) \sim x^{0}$, the positive intercept for ${\rm Re}(F_{1,2})$, implies that it is expected to dominate over the gluon Siver function in the small-$x$ limit - and may directly impact the modeling of unpolarised GTMDs and associated spin-flip processes.


title: On the complexity of polygonal billiards

abstract: We show that the complexity of the billiard in a typical polygon grows cubically and the number of saddle connections grows quadratically along certain subsequences. It is known that the set of points whose first n-bounces hits the same sequence of sides as the orbit of an aperiodic phase point z converges to z. We establishe a polynomial lower bound estimate on this convergence rate for almost every z. This yields an upper bound on the upper metric complexity and upper slow entropy of polygonal billiards. We also prove significant deviations from the expected convergence behavior. Finally we extend these results to higher dimensions as well as to arbitrary invariant measures.


title: Using a Large Language Model to generate a Design Structure Matrix

abstract: The Design Structure Matrix (DSM) is an established method used in dependency modelling, especially in the design of complex engineering systems. The generation of DSM is traditionally carried out through manual means and can involve interviewing experts to elicit critical system elements and the relationships between them. Such manual approaches can be time-consuming and costly. This paper presents a workflow that uses a Large Language Model (LLM) to support the generation of DSM and improve productivity. A prototype of the workflow was developed in this work and applied on a diesel engine DSM published previously. It was found that the prototype could reproduce 357 out of 462 DSM entries published (i.e. 77.3%), suggesting that the work can aid DSM generation. A no-code version of the prototype is made available online to support future research.


title: A Novel Federated Learning-Based IDS for Enhancing UAVs Privacy and Security

abstract: Unmanned aerial vehicles (UAVs) operating within Flying Ad-hoc Networks (FANETs) encounter security challenges due to the dynamic and distributed nature of these networks. Previous studies predominantly focused on centralized intrusion detection, assuming a central entity responsible for storing and analyzing data from all devices.However, these approaches face challenges including computation and storage costs, along with a single point of failure risk, threatening data privacy and availability. The widespread dispersion of data across interconnected devices underscores the necessity for decentralized approaches. This paper introduces the Federated Learning-based Intrusion Detection System (FL-IDS), addressing challenges encountered by centralized systems in FANETs. FL-IDS reduces computation and storage costs for both clients and the central server, crucial for resource-constrained UAVs. Operating in a decentralized manner, FL-IDS enables UAVs to collaboratively train a global intrusion detection model without sharing raw data, thus avoiding the delay in decisions based on collected data, as is often the case with traditional methods. Experimental results demonstrate FL-IDS's competitive performance with Central IDS (C-IDS) while mitigating privacy concerns, with the Bias Towards Specific Clients (BTSC) method further enhancing FL-IDS performance even at lower attacker ratios. Comparative analysis with traditional intrusion detection methods, including Local IDS (L-IDS), sheds light on FL-IDS's strengths. This study significantly contributes to UAV security by introducing a privacy-aware, decentralized intrusion detection approach tailored to UAV networks. Moreover, by introducing a realistic dataset for FANETs and federated learning, our approach differs from others lacking high dynamism and 3D node movements or accurate federated data federations.


title: Surface distribution of small-scale magnetic field on the active cool star LQ Hydrae

abstract: It is well known that small-scale magnetism dominates the surface magnetic field topologies of active late-type stars. However, little information is available on the spatial distribution of this key magnetic field component. Here, we take advantage of the recently developed magnetic field diagnostic procedure relying on the magnetic intensification of iron atomic lines in the optical. We extend this methodology from measuring a single average field strength value to simultaneous Doppler imaging reconstruction of the two-dimensional maps of temperature and magnetic field strength. We applied this novel surface mapping approach to two spectroscopic data sets of the young active Sun-like star LQ Hya. For both epochs, we found a fairly uniform field strength distribution, apart from a latitudinal trend of the field strength increasing from 1.5-2.0 kG at low latitudes to 3.0-3.5 kG, close to the rotational poles. This distribution of the small-scale field does not display a clear correlation with the locations of temperature spots or the global magnetic field structure reconstructed for the same epochs.


title: Dark Sage: Next-generation semi-analytic galaxy evolution with multidimensional structure and minimal free parameters

abstract: After more than five years of development, we present a new version of Dark Sage, a semi-analytic model (SAM) of galaxy formation that breaks the mould for models of its kind. Included among the major changes is an overhauled treatment of stellar feedback that is derived from energy conservation, operates on local scales, affects gas gradually over time rather than instantaneously, and predicts a mass-loading factor for every galaxy. Building on the model's resolved angular-momentum structure of galaxies, we now consider the heating of stellar discs, delivering predictions for disc structure both radially and vertically. We add a further dimension to stellar discs by tracking the distribution of stellar ages in each annulus. Each annulus--age bin has its own velocity dispersion and metallicity evolved in the model. This allows Dark Sage to make structural predictions for galaxies that previously only hydrodynamic simulations could. We present the model as run on the merger trees of the highest-resolution gravity-only simulation of the MillenniumTNG suite. Despite its additional complexity relative to other SAMs, Dark Sage only has three free parameters, the least of any SAM, which we calibrate exclusively against the cosmic star formation history and the $z=0$ stellar and HI mass functions using a particle-swarm optimisation method. The Dark Sage codebase, written in C and Python, is publicly available at https://github.com/arhstevens/DarkSage


title: Attenuation of flexural phonons in free-standing crystalline two-dimensional materials

abstract: We develop the theory for dynamics of the out-of-plane deformations in flexible two-dimensional materials. We focus on study of attenuation of flexural phonons in free-standing crystalline membranes. We demonstrate that the dynamical renormalization does not involve the ultraviolet divergent logarithmic contributions contrary to the static ones. This fact allows us to find the scaling form of the attenuation, determine its small and large frequency asymptotes, and to derive the exact expression for the dynamical exponent of flexural phonons in the long wave limit: $\textsf{z}{=}2{-}\eta/2$. Here $\eta$ is the universal exponent controlling the static renormalization of the bending rigidity. Also we determine the dynamical exponent for the long-wave in-plane phonons: $\textsf{z}^\prime{=}(2{-}\eta)/(1{-}\eta/2)$. We discuss implication of our results to experiments on phonon spectra in graphene and dynamics of graphene-based nanomechanical resonators.


title: Narrowing of the flexural phonon spectral line in stressed crystalline two-dimensional materials

abstract: We develop the microscopic theory for the attenuation of out-of-plane phonons in stressed flexible two-dimensional crystalline materials. We demonstrate that the presence of nonzero tension strongly reduces the relative magnitude of the attenuation and, consequently, results in parametrical narrowing of the phononspectral line. We predict the specific power-law dependence of the spectral-line width on temperature and tension. We speculate that suppression of the phonon attenuation by nonzero tension might be responsible for high quality factors of mechanical nanoresonators based on flexural two-dimensional materials.


title: Polarimetric Light Transport Analysis for Specular Inter-reflection

abstract: Polarization is well known for its ability to decompose diffuse and specular reflections. However, the existing decomposition methods only focus on direct reflection and overlook multiple reflections, especially specular inter-reflection. In this paper, we propose a novel decomposition method for handling specular inter-reflection of metal objects by using a unique polarimetric feature: the rotation direction of linear polarization. This rotation direction serves as a discriminative factor between direct and inter-reflection on specular surfaces. To decompose the reflectance components, we actively rotate the linear polarization of incident light and analyze the rotation direction of the reflected light. We evaluate our method using both synthetic and real data, demonstrating its effectiveness in decomposing specular inter-reflections of metal objects. Furthermore, we demonstrate that our method can be combined with other decomposition methods for a detailed analysis of light transport. As a practical application, we show its effectiveness in improving the accuracy of 3D measurement against strong specular inter-reflection.


title: Distributed Approximate Computing with Constant Locality

abstract: Consider a distributed coding for computing problem with constant decoding locality, i.e., with a vanishing error probability, any single sample of the function can be approximately recovered by probing only constant number of compressed bits. We establish an achievable rate region by designing an efficient layered coding scheme, where the coding rate is reduced by introducing auxiliary random variables and local decoding is achieved by exploiting the expander graph code. Then we show the rate region is optimal under mild regularity conditions on source distributions. The proof relies on the reverse hypercontractivity and a rounding technique to construct auxiliary random variables. The rate region is strictly smaller than that for the classical problem without the constant locality constraint in most cases, which indicates that more rate is required in order to achieve lower coding complexity. Moreover, a coding for computing problem with side information is analogously studied. We also develop graph characterizations, which simplifies the computation of the achievable rate region.


title: TimeDRL: Disentangled Representation Learning for Multivariate Time-Series

abstract: Multivariate time-series data in numerous real-world applications (e.g., healthcare and industry) are informative but challenging due to the lack of labels and high dimensionality. Recent studies in self-supervised learning have shown their potential in learning rich representations without relying on labels, yet they fall short in learning disentangled embeddings and addressing issues of inductive bias (e.g., transformation-invariance). To tackle these challenges, we propose TimeDRL, a generic multivariate time-series representation learning framework with disentangled dual-level embeddings. TimeDRL is characterized by three novel features: (i) disentangled derivation of timestamp-level and instance-level embeddings from patched time-series data using a [CLS] token strategy; (ii) utilization of timestamp-predictive and instance-contrastive tasks for disentangled representation learning, with the former optimizing timestamp-level embeddings with predictive loss, and the latter optimizing instance-level embeddings with contrastive loss; and (iii) avoidance of augmentation methods to eliminate inductive biases, such as transformation-invariance from cropping and masking. Comprehensive experiments on 6 time-series forecasting datasets and 5 time-series classification datasets have shown that TimeDRL consistently surpasses existing representation learning approaches, achieving an average improvement of forecasting by 58.02% in MSE and classification by 1.48% in accuracy. Furthermore, extensive ablation studies confirmed the relative contribution of each component in TimeDRL's architecture, and semi-supervised learning evaluations demonstrated its effectiveness in real-world scenarios, even with limited labeled data. The code is available at https://github.com/blacksnail789521/TimeDRL.


title: Towards 4D Human Video Stylization

abstract: We present a first step towards 4D (3D and time) human video stylization, which addresses style transfer, novel view synthesis and human animation within a unified framework. While numerous video stylization methods have been developed, they are often restricted to rendering images in specific viewpoints of the input video, lacking the capability to generalize to novel views and novel poses in dynamic scenes. To overcome these limitations, we leverage Neural Radiance Fields (NeRFs) to represent videos, conducting stylization in the rendered feature space. Our innovative approach involves the simultaneous representation of both the human subject and the surrounding scene using two NeRFs. This dual representation facilitates the animation of human subjects across various poses and novel viewpoints. Specifically, we introduce a novel geometry-guided tri-plane representation, significantly enhancing feature representation robustness compared to direct tri-plane optimization. Following the video reconstruction, stylization is performed within the NeRFs' rendered feature space. Extensive experiments demonstrate that the proposed method strikes a superior balance between stylized textures and temporal coherence, surpassing existing approaches. Furthermore, our framework uniquely extends its capabilities to accommodate novel poses and viewpoints, making it a versatile tool for creative human video stylization.


title: A sum up method for solving summations of the form $\sum_{k=n_0}^{n} A_{n,k}$ and rising and falling factorial transforms

abstract: In this paper, we discuss a method that utilizes the recurrence of $A_{n,k}$ to solve summations of the form $\sum_{k=n_0}^{n} A_{n,k}$. It is observed that by repeating the procedure, the upper bound of summation is reduced and tilts toward the lower bound. This method of summation is mostly suitable for combinatorial sequences such as binomial coefficients, Stirling numbers of both kinds, etc. After the main method is displayed, some examples are illustrated. Some useful identities about Stirling and r-Stirling numbers are obtained. Finally, two transforms called rising and falling factorial transforms which turn the basis of power polynomials into factorial basis are derived. These transforms verify and simplify the results obtained in the examples section. Also, these transforms describe the relationship between fractional derivatives (or fractional integrals) and falling factorial (or rising factorial) by its series expansion.


title: Diffusing Colors: Image Colorization with Text Guided Diffusion

abstract: The colorization of grayscale images is a complex and subjective task with significant challenges. Despite recent progress in employing large-scale datasets with deep neural networks, difficulties with controllability and visual quality persist. To tackle these issues, we present a novel image colorization framework that utilizes image diffusion techniques with granular text prompts. This integration not only produces colorization outputs that are semantically appropriate but also greatly improves the level of control users have over the colorization process. Our method provides a balance between automation and control, outperforming existing techniques in terms of visual quality and semantic coherence. We leverage a pretrained generative Diffusion Model, and show that we can finetune it for the colorization task without losing its generative power or attention to text prompts. Moreover, we present a novel CLIP-based ranking model that evaluates color vividness, enabling automatic selection of the most suitable level of vividness based on the specific scene semantics. Our approach holds potential particularly for color enhancement and historical image colorization.


title: High-throughput study of the phase constitution of the thin film system Mg-Mn-Al-O in relation to Li recovery from slags

abstract: The increasing importance of recycling makes the recovery of valuable elements from slags interesting, e.g., by the concept of engineered artificial minerals (EnAMs). In this concept, it is aimed for the formation of EnAMs, meaning phase(s) with a high content of the to-be-recovered element(s) from slags of pyrometallurgical recycling processes. For this, understanding the phase constitution of the slag systems is of high importance. The system Mg-Mn-Al-O is a metal oxide slag subsystem from Li-ion battery recycling, that is critical for the formation of spinel phases, which are competing phases to the possible Li-containing EnAM phase LiAlO2. Here, the phase constitution was investigated using a thin film materials library that covers the composition space (Mg14-69Mn11-38Al14-74)Ox. By means of high-throughput energy-dispersive X-ray spectroscopy and X-ray diffraction, the formation of the spinel solid solution phase was confirmed for a wide composition space. Increasing preferential orientation of the spinel solid solution along (400) with increasing Mg content was identified. X-ray photoelectron spectroscopy was used to measure the near-surface composition of selected areas of the materials library, and detailed peak fitting of the Mn 2p3/2 region revealed the Mn oxidation state to be a mixture of Mn2+ and Mn3+. For one measurement area of the materials library containing equal atomic amounts of Mg, Mn and Al, transmission electron microscopy showed that the approximately 420 nm-thick film consists of columnar spinel grains with Mg, Mn and Al being evenly distributed. Based on these results, we suggest that the shown high likelihood of spinel formation in slags might be influenced by controlling the Mn oxidation state to enable the formation of desirable EnAM phases.


title: An Improved Masking Strategy for Self-supervised Masked Reconstruction in Human Activity Recognition

abstract: Masked reconstruction serves as a fundamental pretext task for self-supervised learning, enabling the model to enhance its feature extraction capabilities by reconstructing the masked segments from extensive unlabeled data. In human activity recognition, this pretext task employed a masking strategy centered on the time dimension. However, this masking strategy fails to fully exploit the inherent characteristics of wearable sensor data and overlooks the inter-channel information coupling, thereby limiting its potential as a powerful pretext task. To address these limitations, we propose a novel masking strategy called Channel Masking. It involves masking the sensor data along the channel dimension, thereby compelling the encoder to extract channel-related features while performing the masked reconstruction task. Moreover, Channel Masking can be seamlessly integrated with masking strategies along the time dimension, thereby motivating the self-supervised model to undertake the masked reconstruction task in both the time and channel dimensions. Integrated masking strategies are named Time-Channel Masking and Span-Channel Masking. Finally, we optimize the reconstruction loss function to incorporate the reconstruction loss in both the time and channel dimensions. We evaluate proposed masking strategies on three public datasets, and experimental results show that the proposed strategies outperform prior strategies in both self-supervised and semi-supervised scenarios.


title: Generalized Damping Torque Analysis of Ultra-Low Frequency Oscillation in the Jerk Space

abstract: Ultra low frequency oscillation (ULFO) is significantly threatening the power system stability. Its unstable mechanism is mostly studied via generalized damping torque analysis method (GDTA). However, the analysis still adopts the framework established for low frequency oscillation. Hence, this letter proposes a GDTA approach in the jerk space for ULFO. A multi-information variable is constructed to transform the system into a new state space, where it is found that the jerk dynamics of the turbine-generator cascaded system is a second-order differential equation. Benefiting from this characteristic, we propose a new form for GDTA using jerk dynamics, which is established in the frequency-frequency acceleration phase space. Then, analytical expressions of all damping torque are provided. Finally, test results verified the proposed theoretical results. The negative damping mechanism is revealed, and parameter adjustment measures are concluded.


title: MAD UFOs: Magnetically Arrested Discs with persistent Ultra-Fast Outflows

abstract: General-relativistic magneto-hydrodynamical (GRMHD) simulations of accreting black holes suggest that the accretion flows form toroidal structures embedded in a large scale component of magnetic field, which becomes organized on length-scales exceeding the gravitational radius of the central black hole. Magnetic field grows gradually until a Magnetically Arrested Disc (MAD) develops that diminishes or inhibits further accretion. We study an outflow that develops in the MAD state in 3D GRMHD simulations. We show that the outflow can be accelerated to relativistic velocities and persist over the course of our simulation. We compare the properties of the outflow from MAD discs with those launched by orbiting secondary at close orbit. The main difference is that the orbiting body launches a more coherent, quasiperiodic ultrafast outflow at lower velocities ($v<0.5c$) while the outflow launched in the MAD state (without the body) has a stochastic behaviour and has an approximately flat velocity distribution between lower and higher outflow velocities, $0.2c<v<0.3c$ and $v>0.5c$.


title: A simple sensitivity analysis method for unmeasured confounders via linear programming with estimating equation constraints

abstract: In estimating the average treatment effect in observational studies, the influence of confounders should be appropriately addressed. To this end, the propensity score is widely used. If the propensity scores are known for all the subjects, bias due to confounders can be adjusted by using the inverse probability weighting (IPW) by the propensity score. Since the propensity score is unknown in general, it is usually estimated by the parametric logistic regression model with unknown parameters estimated by solving the score equation under the strongly ignorable treatment assignment (SITA) assumption. Violation of the SITA assumption and/or misspecification of the propensity score model can cause serious bias in estimating the average treatment effect. To relax the SITA assumption, the IPW estimator based on the outcome-dependent propensity score has been successfully introduced. However, it still depends on the correctly specified parametric model and its identification. In this paper, we propose a simple sensitivity analysis method for unmeasured confounders. In the standard practice, the estimating equation is used to estimate the unknown parameters in the parametric propensity score model. Our idea is to make inference on the average causal effect by removing restrictive parametric model assumptions while still utilizing the estimating equation. Using estimating equations as constraints, which the true propensity scores asymptotically satisfy, we construct the worst-case bounds for the average treatment effect with linear programming. Different from the existing sensitivity analysis methods, we construct the worst-case bounds with minimal assumptions. We illustrate our proposal by simulation studies and a real-world example.


title: The Ly$\alpha$ non-detection by JWST NIRSpec of a strong Ly$\alpha$ emitter at $z=5.66$ confirmed by MUSE

abstract: The detections of Lyman-$\alpha$ ($\rm Ly\alpha$) emission in galaxies with redshifts above 5 are of utmost importance for constraining the cosmic reionization timeline, yet such detections are usually based on slit spectroscopy. Here we investigate the significant bias induced by slit placement on the estimate of $\rm Ly\alpha$ escape fraction ( $f_{\rm esc}^{\mathrm{Ly\alpha}}$), by presenting a galaxy (dubbed A2744-z6Lya) at $z=5.66$ where its deep JWST NIRSpec prism spectroscopy completely misses the strong $\rm Ly\alpha$ emission detected in the MUSE data. A2744-z6Lya exhibits a pronounced UV continuum with an extremely steep spectral slope of $\beta=-2.574_{-0.008}^{+0.008}$, and it has a stellar mass of $\mathrm{\sim10^{8.82}~M_\odot}$, a star-formation rate of $\mathrm{\sim8.35~M_\odot yr^{-1}}$ and gas-phase metallicity of $\mathrm{12+log\,(O/H)\sim7.88}$. The observed flux and rest-frame equivalent width of its Ly$\alpha$ from MUSE spectroscopy are $1.2\times \rm 10^{-16} erg~s^{-1}cm^{-2}$ and 75\r{A}, equivalent to $f_{\rm esc}^{\mathrm{Ly\alpha}}=78\pm4 \%$. However, its Ly$\alpha$ non-detection from JWST NIRSpec gives a 5-$\sigma$ upper limit of $<13 \%$, in stark contrast to that derived from MUSE. To explore the reasons for this bias, we perform spatially resolved stellar population analysis of A2744-z6Lya using the JWST NIRCam imaging data to construct 2-dimensional maps of SFR, dust extinction and neutral hydrogen column density. We find that the absence of Ly$\alpha$ in the slit regions probably stems from both the resonance scattering effect of neutral hydrogen and dust extinction. Through analyzing an extreme case in detail, this work highlights the important caveat of inferring $f_{\rm esc}^{\mathrm{Ly\alpha}}$ from slit spectroscopy, particularly when using the JWST multiplexed NIRSpec microshutter assembly.


title: EulerMormer: Robust Eulerian Motion Magnification via Dynamic Filtering within Transformer

abstract: Video Motion Magnification (VMM) aims to break the resolution limit of human visual perception capability and reveal the imperceptible minor motion that contains valuable information in the macroscopic domain. However, challenges arise in this task due to photon noise inevitably introduced by photographic devices and spatial inconsistency in amplification, leading to flickering artifacts in static fields and motion blur and distortion in dynamic fields in the video. Existing methods focus on explicit motion modeling without emphasizing prioritized denoising during the motion magnification process. This paper proposes a novel dynamic filtering strategy to achieve static-dynamic field adaptive denoising. Specifically, based on Eulerian theory, we separate texture and shape to extract motion representation through inter-frame shape differences, expecting to leverage these subdivided features to solve this task finely. Then, we introduce a novel dynamic filter that eliminates noise cues and preserves critical features in the motion magnification and amplification generation phases. Overall, our unified framework, EulerMormer, is a pioneering effort to first equip with Transformer in learning-based VMM. The core of the dynamic filter lies in a global dynamic sparse cross-covariance attention mechanism that explicitly removes noise while preserving vital information, coupled with a multi-scale dual-path gating mechanism that selectively regulates the dependence on different frequency features to reduce spatial attenuation and complement motion boundaries. We demonstrate extensive experiments that EulerMormer achieves more robust video motion magnification from the Eulerian perspective, significantly outperforming state-of-the-art methods. The source code is available at https://github.com/VUT-HFUT/EulerMormer.


title: Off-diagonal approach to the exact solution of quantum integrable systems

abstract: We investigate the $t$-$W$ scheme for the anti-ferromagnetic XXX spin chain under both periodic and open boundary conditions. We propose a new parametrization of the eigenvalues of transfer matrix. Based on it, we obtain the exact solution of the system. By analyzing the distribution of zero roots at the ground state, we obtain the explicit expressions of the eigenfunctions of the transfer matrix and the associated $\mathbb{W}$ operator (see (2.8) and (3.20)) in the thermodynamic limit. We find that the ratio of the quantum determinant with the eigenvalue of $\mathbb{W}$ operator for the ground state exhibits exponential decay behavior. Thus this fact ensures that the so-called inversion relation (the $t-W$ relation without the $W$-term) can be used to study the ground state properties of quantum integrable systems with/without $U(1)$-symmetry in the thermodynamic limit.


title: Total energy beyond GW : exact results and guidelines for approximations

abstract: The total energy and electron addition and removal spectra can in principle be obtained exactly from the one-body Green's function. In practice, the Green's function is obtained from an approximate self-energy. In the framework of many-body perturbation theory, we derive different expressions that are based on an approximate self-energy, but that yield nevertheless in principle the exact exchange-correlation contribution to the total energy for any interaction strength. Response functions play a crucial role, which explains why, for example, ingredients from time-dependent density functional theory can be used to build these approximate self-energies. We show that the key requirement for obtaining exact results is the consistent combination of ingredients. Also when further approximations are made, as it is necessary in practice, this consistency remains the key to obtain good results. All findings are illustrated using the exactly solvable symmetric Hubbard dimer.


title: Resource Allocation for Semantic Communication under Physical-layer Security

abstract: Semantic communication is deemed as a revolution of Shannon's paradigm in the six-generation (6G) wireless networks. It aims at transmitting the extracted information rather than the original data, which receivers will try to recover. Intuitively, the larger extracted information, the longer latency of semantic communication will be. Besides, larger extracted information will result in more accurate reconstructed information, thereby causing a higher utility of the semantic communication system. Shorter latency and higher utility are desirable objectives for the system, so there will be a trade-off between utility and latency. This paper proposes a joint optimization algorithm for total latency and utility. Moreover, security is essential for the semantic communication system. We incorporate the secrecy rate, a physical-layer security method, into the optimization problem. The secrecy rate is the communication rate at which no information is disclosed to an eavesdropper. Experimental results demonstrate that the proposed algorithm obtains the best joint optimization performance compared to the baselines.


title: Quality control of eggs using multivariate analysis of micro-Raman spectroscopy

abstract: Considering the pivotal role of eggs in the food industry and their nutritional significance, this study employed micro-Raman spectroscopy of eggs, examining both shells and yolks to assess the quality and freshness of eggs. Raman spectra were collected at different temperatures and time intervals to investigate temperature and time effects, potentially indicating Raman peak reduction due to Maillard reaction and oxidation of proteins and lipids and carotenoid depletion, respectively. By calculating the ratio of Raman peaks, lipids, fatty acids, and choline methyl were introduced as biomarkers of temperature and time. Notable correlations were identified between Raman peaks and egg quality coefficients, including egg coefficient and peak 1002 cm$^{-1}$ (protein), total weight and 1301 cm$^{-1}$ (Lipids), yolk weight and 2934 and 3057 cm$^{-1}$, total weight with peak 710 cm$^{-1}$, and egg shape index and peak 3057 cm$^{-1}$. Analysis of eggshells at different time intervals revealed Raman peak reduction during time, demonstrating Raman's effectiveness in assessing egg quality from its shell. Using the PLS-DA method, the classification of eggs at different temperatures and storage times using egg yolk Raman spectra was performed with 80% accuracy, predominantly influenced by carotenoid peaks, showing Raman a practical, and non-destructive method for egg quality and freshness control.


title: Evolution of the magnetic field and flows of solar active regions with persistent magnetic bipoles before emergence

abstract: Magnetic active regions on the Sun are harbingers of space weather events. Understanding the physics of how they form and evolve will improve space weather forecasting. Our aim is to characterise the surface magnetic field and flows for a sample of active regions with persistent magnetic bipoles prior to emergence. We identified 42 emerging active regions (EARs), in the Solar Dynamics Observatory Helioseismic Emerging Active Region survey (Schunker et al. 2016), associated with small magnetic bipoles at least one day before the time of emergence. We then identified a contrasting sample of 42 EARs that emerge more abruptly without bipoles before emergence. We computed the supergranulation scale surface flows using helioseismic holography. We averaged the flow maps and magnetic field maps over all active regions in each sample at each time interval from 2 days before emergence to 1 day after. We found that EARs associated with a persistent pre-emergence bipole evolve to be, on average, lower flux active regions than EARs that emerge more abruptly. Further, we found that the EARs that emerge more abruptly do so with a diverging flow of $(3\pm 0.6) \times 10^{-6}$ s$^{-1}$ on the order of 50-100 ms$^{-1}$. Our results suggest that there is a statistical dependence of the surface flow signature throughout the emergence process on the maximum magnetic flux of the active region.


title: Safety-Enhanced Self-Learning for Optimal Power Converter Control

abstract: Data-driven learning-based control methods such as reinforcement learning (RL) have become increasingly popular with recent proliferation of the machine learning paradigm. These methods address the parameter sensitiveness and unmodeled dynamics in model-based controllers, such as finite control-set model predictive control. RL agents are typically utilized in simulation environments, where they are allowed to explore multiple "unsafe" actions during the learning process. However, this type of learning is not applicable to online self-learning of controllers in physical power converters, because unsafe actions would damage them. To address this, this letter proposes a safe online RL-based control framework to autonomously find the optimal switching strategy for the power converters, while ensuring system safety during the entire self-learning process. The proposed safe online RL-based control is validated in a practical testbed on a two-level voltage source converter system, and the results confirm the effectiveness of the proposed method.


title: Zero-Touch Networks: Towards Next-Generation Network Automation

abstract: The Zero-touch network and Service Management (ZSM) framework represents an emerging paradigm in the management of the fifth-generation (5G) and Beyond (5G+) networks, offering automated self-management and self-healing capabilities to address the escalating complexity and the growing data volume of modern networks. ZSM frameworks leverage advanced technologies such as Machine Learning (ML) to enable intelligent decision-making and reduce human intervention. This paper presents a comprehensive survey of Zero-Touch Networks (ZTNs) within the ZSM framework, covering network optimization, traffic monitoring, energy efficiency, and security aspects of next-generational networks. The paper explores the challenges associated with ZSM, particularly those related to ML, which necessitate the need to explore diverse network automation solutions. In this context, the study investigates the application of Automated ML (AutoML) in ZTNs, to reduce network management costs and enhance performance. AutoML automates the selection and tuning process of a ML model for a given task. Specifically, the focus is on AutoML's ability to predict application throughput and autonomously adapt to data drift. Experimental results demonstrate the superiority of the proposed AutoML pipeline over traditional ML in terms of prediction accuracy. Integrating AutoML and ZSM concepts significantly reduces network configuration and management efforts, allowing operators to allocate more time and resources to other important tasks. The paper also provides a high-level 5G system architecture incorporating AutoML and ZSM concepts. This research highlights the potential of ZTNs and AutoML to revolutionize the management of 5G+ networks, enabling automated decision-making and empowering network operators to achieve higher efficiency, improved performance, and enhanced user experience.


title: Text as Image: Learning Transferable Adapter for Multi-Label Classification

abstract: Pre-trained vision-language models have notably accelerated progress of open-world concept recognition. Their impressive zero-shot ability has recently been transferred to multi-label image classification via prompt tuning, enabling to discover novel labels in an open-vocabulary manner. However, this paradigm suffers from non-trivial training costs, and becomes computationally prohibitive for a large number of candidate labels. To address this issue, we note that vision-language pre-training aligns images and texts in a unified embedding space, making it potential for an adapter network to identify labels in visual modality while be trained in text modality. To enhance such cross-modal transfer ability, a simple yet effective method termed random perturbation is proposed, which enables the adapter to search for potential visual embeddings by perturbing text embeddings with noise during training, resulting in better performance in visual modality. Furthermore, we introduce an effective approach to employ large language models for multi-label instruction-following text generation. In this way, a fully automated pipeline for visual label recognition is developed without relying on any manual data. Extensive experiments on public benchmarks show the superiority of our method in various multi-label classification tasks.


title: Modeling and Numerical Analysis of Kangaroo Lower Body based on Constrained Dynamics of Hybrid Serial-Parallel Floating-Base Systems

abstract: This paper presents the modeling and numerical analysis of the Kangaroo lower body prototype, a novel bipedal humanoid robot developed and manufactured by PAL Robotics. Kangaroo features high-power linear electric actuators combined with unique serial-parallel hybrid chains, which allow for the positioning of all the leg actuators near the base of the robot in order to improve the overall mass distribution. To model and analyze such complex nonlinear mechanisms, we employ a constrained formulation that is extended to account for floating-base systems in contact with the environment. A comparison is made to demonstrate the significant improvements achieved with TALOS, another humanoid bipedal robot designed by PAL Robotics, in terms of equivalent Cartesian inertia at the feet and centroidal angular momentum. Finally, the paper includes numerical experiments conducted through simulation and preliminary tests performed on the actual Kangaroo platform.


title: Torsion-free abelian groups are faithfully Borel complete and pure embeddability is a complete analytic quasi-order

abstract: In [9] we proved that the space of countable torsion-free abelian groups is Borel complete. In this paper we show that our construction from [9] satisfies several additional properties of interest. We deduce from this that countable torsion-free abelian groups are faithfully Borel complete, in fact, more strongly, we can $\mathfrak{L}_{\omega_1, \omega}$-interpret countable graphs in them. Secondly, we show that the relation of pure embeddability (equiv., elementary embeddability) among countable models of $\mathrm{Th}(\mathbb{Z}^{(\omega)})$ is a complete analytic quasi-order.


title: Multi-scale Residual Transformer for VLF Lightning Transients Classification

abstract: The utilization of Very Low Frequency (VLF) electromagnetic signals in navigation systems is widespread. However, the non-stationary behavior of lightning signals can affect VLF electromagnetic signal transmission. Accurately classifying lightning signals is important for reducing interference and noise in VLF, thereby improving the reliability and overall performance of navigation systems. In recent years, the evolution of deep learning, specifically Convolutional Neural Network (CNNs), has sparked a transformation in lightning classification, surpassing traditional statistical methodologies. Existing CNN models have limitations as they overlook the diverse attributes of lightning signals across different scales and neglect the significance of temporal sequencing in sequential signals. This study introduces an innovative multi-scale residual transform (MRTransformer) that not only has the ability to discern intricate fine-grained patterns while also weighing the significance of different aspects within the input lightning signal sequence. This model performs the attributes of the lightning signal across different scales and the level of accuracy reached 90% in the classification. In future work, this model has the potential applied to a comprehensive understanding of the localization and waveform characteristics of lightning signals.


title: Nonlocal quantum differentiation between polarization objects using entanglement

abstract: For a wide range of applications a fast, non-destructive, remote, and sensitive identification of samples with predefined characteristics is preferred instead of their full characterization. Here, we report on the experimental implementation of a nonlocal quantum measurement scheme enabling to distinguish different transparent and birefringent samples by means of polarization-entangled photon pairs and remote state preparation. On an example set of more than 80 objects with varying Mueller matrices we show that only two coincidence measurements are already sufficient for successful discrimination in contrast to at least 8 required for a comprehensive inspection. The decreased number of measurements and the sample set significantly exceeding a typical set size for various problems demonstrate the high potential of the method for applications aiming at biomedical diagnostics, remote sensing, and other classification/detection tasks.


title: Triple-GEM detectors for the Phase-2 upgrade of the CMS muon spectrometer

abstract: The High-Luminosity LHC will deliver an unprecedented instantaneous luminosity, requiring all experiments to upgrade their detectors to sustain the higher background rates. The upgrade of the CMS Muon spectrometer includes three stations of triple-GEM detectors. We present the status of the commissioning and performance validation of the three GEM stations: GE1/1, which is taking data in Run 3, GE2/1, for which the first detectors will be installed in 2024, and ME0, which has undergone several performance studies for high-rate and longevity and will start its mass production in 2024.


title: Improving Communication Efficiency of Federated Distillation via Accumulating Local Updates

abstract: As an emerging federated learning paradigm, federated distillation enables communication-efficient model training by transmitting only small-scale knowledge during the learning process. To further improve the communication efficiency of federated distillation, we propose a novel technique, ALU, which accumulates multiple rounds of local updates before transferring the knowledge to the central server. ALU drastically decreases the frequency of communication in federated distillation, thereby significantly reducing the communication overhead during the training process. Empirical experiments demonstrate the substantial effect of ALU in improving the communication efficiency of federated distillation.


title: Mixture of Dynamical Variational Autoencoders for Multi-Source Trajectory Modeling and Separation

abstract: In this paper, we propose a latent-variable generative model called mixture of dynamical variational autoencoders (MixDVAE) to model the dynamics of a system composed of multiple moving sources. A DVAE model is pre-trained on a single-source dataset to capture the source dynamics. Then, multiple instances of the pre-trained DVAE model are integrated into a multi-source mixture model with a discrete observation-to-source assignment latent variable. The posterior distributions of both the discrete observation-to-source assignment variable and the continuous DVAE variables representing the sources content/position are estimated using a variational expectation-maximization algorithm, leading to multi-source trajectories estimation. We illustrate the versatility of the proposed MixDVAE model on two tasks: a computer vision task, namely multi-object tracking, and an audio processing task, namely single-channel audio source separation. Experimental results show that the proposed method works well on these two tasks, and outperforms several baseline methods.


title: Augmentation-Free Dense Contrastive Knowledge Distillation for Efficient Semantic Segmentation

abstract: In recent years, knowledge distillation methods based on contrastive learning have achieved promising results on image classification and object detection tasks. However, in this line of research, we note that less attention is paid to semantic segmentation. Existing methods heavily rely on data augmentation and memory buffer, which entail high computational resource demands when applying them to handle semantic segmentation that requires to preserve high-resolution feature maps for making dense pixel-wise predictions. In order to address this problem, we present Augmentation-free Dense Contrastive Knowledge Distillation (Af-DCD), a new contrastive distillation learning paradigm to train compact and accurate deep neural networks for semantic segmentation applications. Af-DCD leverages a masked feature mimicking strategy, and formulates a novel contrastive learning loss via taking advantage of tactful feature partitions across both channel and spatial dimensions, allowing to effectively transfer dense and structured local knowledge learnt by the teacher model to a target student model while maintaining training efficiency. Extensive experiments on five mainstream benchmarks with various teacher-student network pairs demonstrate the effectiveness of our approach. For instance, the DeepLabV3-Res18|DeepLabV3-MBV2 model trained by Af-DCD reaches 77.03%|76.38% mIOU on Cityscapes dataset when choosing DeepLabV3-Res101 as the teacher, setting new performance records. Besides that, Af-DCD achieves an absolute mIOU improvement of 3.26%|3.04%|2.75%|2.30%|1.42% compared with individually trained counterpart on Cityscapes|Pascal VOC|Camvid|ADE20K|COCO-Stuff-164K. Code is available at https://github.com/OSVAI/Af-DCD


title: On the non-vanishing of Hilbert Poincar\'e series

abstract: We prove that if $\nu$ has small norm with respect to the level and the weight, the $\nu$-th Hilbert Poincar\'e series does not vanish identically. We also prove Selberg's identity on Kloosterman sums in the case of number fields, which implies certain vanishing and non-vanishing relations of Hilbert Poincar\'e series when the narrow class number is $1$. Finally, we pass to the adelic setting and interpret the problem via Hecke operators.


title: A new enigmatic radio relic in the low mass cluster Abell 2108

abstract: We report the discovery of a radio relic in the northeastern periphery of the cluster Abell 2108 (A2108). A2108 is a part of the uGMRT LOw-MAss Galaxy Cluster Survey (GLOMACS), where our main aim is to search for diffuse radio emission signatures in very sparsely explored low-mass galaxy clusters using uGMRT band-3 (central frequency 400 MHz). We used our uGMRT band-3 data along with the existing archival band-3 uGMRT data to improve image sensitivity. Along with the previously reported southwestern relic, the discovery of the new relic makes A2108 one of the few low-mass clusters hosting double relics. The new relic spans over a region of 610 kpc $\times$ 310 kpc and, interestingly, differs considerably in size and morphology from the other relic. With XMM-Newton science archive data, we also report the tentative detection of a mildly supersonic shock of Mach number $\mathcal{M}_\mathrm{SB}=1.42$ and $\mathcal{M}_\mathrm{T} = 1.43$ from the surface brightness and temperature discontinuities, respectively near this newly found relic. Both the relics in A2108 are found to be significantly under-luminous compared to other double relic systems in the mass-luminosity plane. Though mild supersonic shocks resulting from an off-axis merger could have influenced their origin, we hypothesize that further local environments have played a crucial role in shaping their morphology.


title: A novel feature selection framework for incomplete data

abstract: Feature selection on incomplete datasets is an exceptionally challenging task. Existing methods address this challenge by first employing imputation methods to complete the incomplete data and then conducting feature selection based on the imputed data. Since imputation and feature selection are entirely independent steps, the importance of features cannot be considered during imputation. However, in real-world scenarios or datasets, different features have varying degrees of importance. To address this, we propose a novel incomplete data feature selection framework that considers feature importance. The framework mainly consists of two alternating iterative stages: the M-stage and the W-stage. In the M-stage, missing values are imputed based on a given feature importance vector and multiple initial imputation results. In the W-stage, an improved reliefF algorithm is employed to learn the feature importance vector based on the imputed data. Specifically, the feature importance vector obtained in the current iteration of the W-stage serves as input for the next iteration of the M-stage. Experimental results on both artificially generated and real incomplete datasets demonstrate that the proposed method outperforms other approaches significantly.


title: On the Absolute-Value Integral of a Brownian Motion with Drift: Exact and Asymptotic Formulae

abstract: The present paper is concerned with the integral of the absolute value of a Brownian motion with drift. By establishing an asymptotic expansion of the space Laplace transform, we obtain series representations for the probability density function and cumulative distribution function of the integral, making use of Meijer's G-function. A functional recursive formula is derived for the moments, which is shown to yield only exponentials and Gauss' error function up to arbitrary orders, permitting exact computations. To obtain sharp asymptotic estimates for small- and large-deviation probabilities, we employ a marginal space-time Laplace transform and apply a newly developed generalization of Laplace's method to exponential Airy integrals. The impact of drift on the complete distribution of the integral is explored in depth. The resultant new formulae complement existing ones in the standard Brownian motion case to great extent in terms of both theoretical generality and modeling capacity and have been presented for easy implementation, which numerical experiments demonstrate.


title: Contract Wallet Using Emails

abstract: We proposed a new construction for contract wallets, smart contract applications that allow users to control their crypto assets. Users can manipulate their crypto assets by simply sending emails with no need to manage keys. These emails are verified using zero-knowledge proof (ZKP) along with their attached digital signatures that the sender domain server (SDS) generates according to DomainKeys Identified Mail. Unless the SDS forges the emails, the crypto assets remain secure in the proposed system. Moreover, the existing SDSs can be used as is by outsourcing additional work to a third party that is not necessarily trusted. The system supports various functions to manipulate crypto assets. We produced a tool for variable-regex mapping (VRM) that enables developers to build a new function without ZKP skills. For example, using the tool, we built a demo application where users can exchange crypto assets via Uniswap only with emails. The published version of this paper is available at https://doi.org/10.1109/ICBC56567.2023.10174932.


title: Coherent energy and force uncertainty in deep learning force fields

abstract: In machine learning energy potentials for atomic systems, forces are commonly obtained as the negative derivative of the energy function with respect to atomic positions. To quantify aleatoric uncertainty in the predicted energies, a widely used modeling approach involves predicting both a mean and variance for each energy value. However, this model is not differentiable under the usual white noise assumption, so energy uncertainty does not naturally translate to force uncertainty. In this work we propose a machine learning potential energy model in which energy and force aleatoric uncertainty are linked through a spatially correlated noise process. We demonstrate our approach on an equivariant messages passing neural network potential trained on energies and forces on two out-of-equilibrium molecular datasets. Furthermore, we also show how to obtain epistemic uncertainties in this setting based on a Bayesian interpretation of deep ensemble models.


title: On Kummer characters arising from Galois actions on the pro-$p$ fundamental groups of once-punctured CM elliptic curves

abstract: In this paper, we study certain Kummer characters arising from the pro-$p$ geometric fundamental groups of CM elliptic curves minus their origins (once-punctured CM elliptic curves). These characters may be regarded as analogues of the Soul\'e characters. We study sufficient conditions under which such characters are nontrivial or even surjective.


title: Temperature-Enhanced Critical Quantum Metrology

abstract: We show that the performance of critical quantum metrology protocols, counter-intuitively, can be enhanced by finite temperature. We consider a toy-model squeezing Hamiltonian, the Lipkin-Meshkov-Glick model and the paradigmatic Ising model. We show that the temperature enhancement of the quantum Fisher information can be achieved by adiabatic preparation of the critical state and by preparing it directly in the proximity of the critical point. We also find a relatively simple, however, non-optimal measurement capable of harnessing finite temperature to increase the parameter estimation sensitivity. Therefore, we argue that temperature can be considered as a resource in critical quantum metrology.


title: Duality and Triality Families of Analytic Black Hole Solutions

abstract: Recent progress in holographic realization of strange metal transport has given us new insights into getting new black hole solutions. In this paper, we consider the $S$-completion and $ST$-completion of the Gubser-Rocha model. The dyonic black holes of the S-type Gubser-Rocha model come in families as $\mathbb{Z}_4$ quartets. For the $ST$-completion, solutions form sextets under $\mathbb{Z}_6$ symmetry. The charge vectors of the solutions in each $\mathbb{Z}_6$-family form a hexagon, realizing six-fold way in gravitational systems.


title: Lattice investigation of the general Two Higgs Doublet Model with $SU(2)$ gauge fields

abstract: We study the most general Two Higgs Doublet Model with $SU(2)$ gauge fields on the lattice. The phase space is probed through the computation of gauge-invariant global observables serving as proxies for order parameters. In each phase, the spectrum of the theory is analysed for different combinations of bare couplings and different symmetry breaking patterns. The scale setting and determination of the running gauge coupling are performed through the Wilson flow computation of the action density.


title: Mancha3D code: Multi-purpose Advanced Non-ideal MHD Code for High resolution simulations in Astrophysics

abstract: The Mancha3D code is a versatile tool for numerical simulations of magnetohydrodynamic processes in solar/stellar atmospheres. The code includes non-ideal physics derived from plasma partial ionization, a realistic equation of state and radiative transfer, which allows performing high quality realistic simulations of magneto-convection, as well as idealized simulations of particular processes, such as wave propagation, instabilities or energetic events. The paper summarizes the equations and methods used in the Mancha3D code. It also describes its numerical stability and parallel performance and efficiency. The code is based on a finite difference discretization and memory-saving Runge-Kutta (RK) scheme. It handles non-ideal effects through super-time stepping and Hall diffusion schemes, and takes into account thermal conduction by solving an additional hyperbolic equation for the heat flux. The code is easily configurable to perform different kinds of simulations. Several examples of the code usage are given. It is demonstrated that splitting variables into equilibrium and perturbation parts is essential for simulations of wave propagation in a static background. A perfectly matched layer (PML) boundary condition built into the code greatly facilitates a non-reflective open boundary implementation. Spatial filtering is an important numerical remedy to eliminate grid-size perturbations enhancing the code stability. Parallel performance analysis reveals that the code is strongly memory bound, which is a natural consequence of the numerical techniques used, such as split variables and PML boundary conditions. Both strong and weak scalings show adequate performance up till several thousands of CPUs.


title: AI and Jobs: Has the Inflection Point Arrived? Evidence from an Online Labor Platform

abstract: Artificial intelligence (AI) refers to the ability of machines or software to mimic or even surpass human intelligence in a given cognitive task. While humans learn by both induction and deduction, the success of current AI is rooted in induction, relying on its ability to detect statistical regularities in task input -- an ability learnt from a vast amount of training data using enormous computation resources. We examine the performance of such a statistical AI in a human task through the lens of four factors, including task learnability, statistical resource, computation resource, and learning techniques, and then propose a three-phase visual framework to understand the evolving relation between AI and jobs. Based on this conceptual framework, we develop a simple economic model of competition to show the existence of an inflection point for each occupation. Before AI performance crosses the inflection point, human workers always benefit from an improvement in AI performance, but after the inflection point, human workers become worse off whenever such an improvement occurs. To offer empirical evidence, we first argue that AI performance has passed the inflection point for the occupation of translation but not for the occupation of web development. We then study how the launch of ChatGPT, which led to significant improvement of AI performance on many tasks, has affected workers in these two occupations on a large online labor platform. Consistent with the inflection point conjecture, we find that translators are negatively affected by the shock both in terms of the number of accepted jobs and the earnings from those jobs, while web developers are positively affected by the very same shock. Given the potentially large disruption of AI on employment, more studies on more occupations using data from different platforms are urgently needed.


title: Cell segmentation of in situ transcriptomics data using signed graph partitioning

abstract: The locations of different mRNA molecules can be revealed by multiplexed in situ RNA detection. By assigning detected mRNA molecules to individual cells, it is possible to identify many different cell types in parallel. This in turn enables investigation of the spatial cellular architecture in tissue, which is crucial for furthering our understanding of biological processes and diseases. However, cell typing typically depends on the segmentation of cell nuclei, which is often done based on images of a DNA stain, such as DAPI. Limiting cell definition to a nuclear stain makes it fundamentally difficult to determine accurate cell borders, and thereby also difficult to assign mRNA molecules to the correct cell. As such, we have developed a computational tool that segments cells solely based on the local composition of mRNA molecules. First, a small neural network is trained to compute attractive and repulsive edges between pairs of mRNA molecules. The signed graph is then partitioned by a mutex watershed into components corresponding to different cells. We evaluated our method on two publicly available datasets and compared it against the current state-of-the-art and older baselines. We conclude that combining neural networks with combinatorial optimization is a promising approach for cell segmentation of in situ transcriptomics data.


title: Bayesian Persuasion for Containing SIS Epidemic with Asymptomatic Infection

abstract: We investigate the strategic behavior of a large population of agents who decide whether to adopt a costly partially effective protection or remain unprotected against the susceptible-infected-susceptible epidemic. In contrast with most prior works on epidemic games, we assume that the agents are not aware of their true infection status while making decisions. We adopt the Bayesian persuasion framework where the agents receive a noisy signal regarding their true infection status, and maximize their expected utility computed using the posterior probability of being infected conditioned on the received signal. We completely characterize the stationary Nash equilibrium of this setting, and identify conditions under which partial information disclosure leads to a smaller proportion of infected individuals at the equilibrium compared to full information disclosure, and vice versa.


title: Enhanced data Detection for Massive MIMO with 1-Bit ADCs

abstract: We present new insightful results on the uplink data detection for massive multiple-input multiple-output systems with 1-bit analog-to-digital converters. The expected values of the soft-estimated symbols (i.e., after the linear combining and prior to the data detection) have been recently characterized for multiple user equipments (UEs) and maximum ratio combining (MRC) receiver at the base station. In this paper, we first provide a numerical evaluation of the expected value of the soft-estimated symbols with zero-forcing (ZF) and minimum mean squared error (MMSE) receivers for a multi-UE setting with correlated Rayleigh fading. Then, we propose a joint data detection (JD) strategy, which exploits the interdependence among the soft-estimated symbols of the interfering UEs, along with its low-complexity variant. These strategies are compared with a naive approach that adapts the maximum-likelihood data detection to the 1-bit quantization. Numerical results show that ZF and MMSE provide considerable gains over MRC in terms of symbol error rate. Moreover, the proposed JD and its low-complexity variant provide a significant boost in comparison with the single-UE data detection.


title: Multifold enhancement of quantum SNR by using an EMCCD as a photon number resolving device

abstract: The Electron Multiplying Charge Coupled Devices (EMCCD), owing to their high quantum efficiency and spatial resolution, are widely used to study typical quantum optical phenomena and related applications. Researchers have already developed a procedure that enables one to statistically determine whether a pixel detects a single photon, based on whether its output is higher or lower than the estimated noise level. However, these techniques are feasible at extremely low photon numbers (about 0.15 mean number of photons per pixel per exposure), allowing for at most one photon per pixel. This limitation necessitates a very large number of frames required for any study. In this work, we present a method to estimate the mean rate of photons per pixel per frame for arbitrary exposure time. Subsequently, we make a statistical estimate of the number of photons (greater than or equal to 1) incident on each pixel. This allows us to effectively utilize the EMCCD as a photon number resolving device. This immediately augments the acceptable light levels in the experiments, leading to significant reduction in the required experimentation time. As evidence of our approach, we quantify contrast in quantum correlation exhibited by a pair of spatially entangled photons generated by Spontaneous Parametric Down Conversion process. In comparison to conventional methods, our method realizes an enhancement in the signal to noise ratio by about a factor of 3 for half the data collection time. This SNR can be easily enhanced by minor modifications in experimental parameters such as exposure time etc.


title: A minimal model for prestacks via Koszul duality for box operads

abstract: Prestacks are algebro-geometric objects whose defining relations are far from quadratic. Indeed, they are cubic and quartic, and moreover inhomogeneous. We show that box operads, a rectangular type of operads introduced in arXiv:2305.20036, constitute the correct framework to encode them and resolve their relations up to homotopy. Our first main result is a Koszul duality theory for box operads, extending the duality for (nonsymmetric) operads. In this new theory, the classical restriction of being quadratic is replaced by the notion of being $\textit{thin-quadratic}$, a condition referring to a particular class of ``thin'' operations. Our main case of interest is the box operad $Lax$ encoding lax prestacks as algebras. We show that $Lax$ is not Koszul by explicitly computing its Koszul complex. We then go on to remedy the situation by suitably restricting the Koszul dual box cooperad $Lax^{\antishriek}$ to obtain our second main result: we establish a minimal (in particular cofibrant) model $Lax_{\infty}$ for the box operad $Lax$ encoding lax prestacks. This sheds new light on Markl's question on the existence of a cofibrant model for the operad encoding presheaves of algebras from arXiv:math/0103052. Indeed, we answer the parallel question with presheaves viewed as prestacks, and prestacks considered as algebras over a box operad, in the positive.


title: Superconducting processor design optimization for quantum error correction performance

abstract: In the quest for fault-tolerant quantum computation using superconducting processors, accurate performance assessment and continuous design optimization stands at the forefront. To facilitate both meticulous simulation and streamlined design optimization, we introduce a multi-level simulation framework that spans both Hamiltonian and quantum error correction levels, and is equipped with the capability to compute gradients efficiently. This toolset aids in design optimization, tailored to specific objectives like quantum memory performance. Within our framework, we investigate the often-neglected spatially correlated unitary errors, highlighting their significant impact on logical error rates. We exemplify our approach through the multi-path coupling scheme of fluxonium qubits.


title: Enumerating Complexity Revisited

abstract: Consider a subset of positive integers $S$. In this paper, we reduce the upper bound on the length of a minimum program that enumerates $S$ in terms of the probability of $S$ being enumerated by a random program. So far, the best-known upper bound was given by Solovay. Solovay proved that the minimum length of a program enumerating $S$ is bounded by $3$ times minus binary logarithm of the probability that a random program enumerates $S$. Later, Vereshchagin showed that the constant can be improved from $3$ to $2$ for finite sets. By improving the method proposed by Solovay, we demonstrate that any bound for finite sets implies the same bound for infinite sets, modulo logarithmic factors. Thus, the constant can be replaced by $2$ for every set $S$ due to the result of Vereshchagin.


title: Zooming on the emerging ionized regions of pPNe with ALMA

abstract: We report on recent results from our successful and pioneering observational program with ALMA to study emerging ultracom pact HII regions of pre-Planetary Nebulae (pPNe) using mm-wavelength recombination lines (mRRLs) as new optimal tracers. We focus on our study of two poster-child pPNe, namely, M2-9 and CRL618. We reveal the structure and kinematics of the en igmatic inner nebular regions of these objects with an unprecedented angular resolution down to 20-30mas (~15-30AU). For both targets, the ionized central regions are elongated along the main symmetry axis of the large-scale nebulae, consiste nt with bipolar winds, and show notable axial velocity gradients with expansion velocities of up to ~100km/s. The H30a pr ofiles exhibit time variability, reflecting changes in the physical properties and kinematics on scales of a few years. O ur ongoing analysis employs 3D, non-LTE radiative transfer modeling, providing a detailed description of the innermost la yers of these well known pPNe with exceptional clarity.


title: Joint-Individual Fusion Structure with Fusion Attention Module for Multi-Modal Skin Cancer Classification

abstract: Most convolutional neural network (CNN) based methods for skin cancer classification obtain their results using only dermatological images. Although good classification results have been shown, more accurate results can be achieved by considering the patient's metadata, which is valuable clinical information for dermatologists. Current methods only use the simple joint fusion structure (FS) and fusion modules (FMs) for the multi-modal classification methods, there still is room to increase the accuracy by exploring more advanced FS and FM. Therefore, in this paper, we design a new fusion method that combines dermatological images (dermoscopy images or clinical images) and patient metadata for skin cancer classification from the perspectives of FS and FM. First, we propose a joint-individual fusion (JIF) structure that learns the shared features of multi-modality data and preserves specific features simultaneously. Second, we introduce a fusion attention (FA) module that enhances the most relevant image and metadata features based on both the self and mutual attention mechanism to support the decision-making pipeline. We compare the proposed JIF-MMFA method with other state-of-the-art fusion methods on three different public datasets. The results show that our JIF-MMFA method improves the classification results for all tested CNN backbones and performs better than the other fusion methods on the three public datasets, demonstrating our method's effectiveness and robustness


title: Receding Horizon Re-ordering of Multi-Agent Execution Schedules

abstract: The trajectory planning for a fleet of Automated Guided Vehicles (AGVs) on a roadmap is commonly referred to as the Multi-Agent Path Finding (MAPF) problem, the solution to which dictates each AGV's spatial and temporal location until it reaches it's goal without collision. When executing MAPF plans in dynamic workspaces, AGVs can be frequently delayed, e.g., due to encounters with humans or third-party vehicles. If the remainder of the AGVs keeps following their individual plans, synchrony of the fleet is lost and some AGVs may pass through roadmap intersections in a different order than originally planned. Although this could reduce the cumulative route completion time of the AGVs, generally, a change in the original ordering can cause conflicts such as deadlocks. In practice, synchrony is therefore often enforced by using a MAPF execution policy employing, e.g., an Action Dependency Graph (ADG) to maintain ordering. To safely re-order without introducing deadlocks, we present the concept of the Switchable Action Dependency Graph (SADG). Using the SADG, we formulate a comparatively low-dimensional Mixed-Integer Linear Program (MILP) that repeatedly re-orders AGVs in a recursively feasible manner, thus maintaining deadlock-free guarantees, while dynamically minimizing the cumulative route completion time of all AGVs. Various simulations validate the efficiency of our approach when compared to the original ADG method as well as robust MAPF solution approaches.


title: Subsets of groups with context-free preimages

abstract: We study subsets $E$ of finitely generated groups where the set of all words over a given finite generating set that lie in $E$ forms a context-free language. We call these sets recognisably context-free. They are invariant of the choice of generating set and a theorem of Muller and Schupp fully classifies when the set $\{1\}$ can be recognisably context-free. We extend Muller and Schupp's result to show that a group $G$ admits a finite recognisably context-free subset if and only if $G$ is virtually free. We show that every conjugacy class of a group $G$ is recognisably context-free if and only if $G$ is virtually free. We conclude by showing that a coset is recognisably context-free if and only if the Schreier coset graph of the corresponding subgroup is quasi-isometric to a tree.


title: Convergence Rate Analysis of Continuous- and Discrete-Time Smoothing Gradient Algorithms

abstract: This paper addresses the gradient flow -- the continuous-time representation of the gradient method -- with the smooth approximation of a non-differentiable objective function and presents convergence analysis framework. Similar to the gradient method, the gradient flow is inapplicable to the non-differentiable function minimization; therefore, this paper addresses the smoothing gradient method, which exploits a decreasing smoothing parameter sequence in the smooth approximation. The convergence analysis is presented using conventional Lyapunov-function-based techniques, and a Lyapunov function applicable to both strongly convex and non-strongly convex objective functions is provided by taking into consideration the effect of the smooth approximation. Based on the equivalence of the stepsize in the smoothing gradient method and the discretization step in the forward Euler scheme for the numerical integration of the smoothing gradient flow, the sample values of the exact solution of the smoothing gradient flow are compared with the state variable of the smoothing gradient method, and the equivalence of the convergence rates is shown.


title: Language Model Knowledge Distillation for Efficient Question Answering in Spanish

abstract: Recent advances in the development of pre-trained Spanish language models has led to significant progress in many Natural Language Processing (NLP) tasks, such as question answering. However, the lack of efficient models imposes a barrier for the adoption of such models in resource-constrained environments. Therefore, smaller distilled models for the Spanish language could be proven to be highly scalable and facilitate their further adoption on a variety of tasks and scenarios. In this work, we take one step in this direction by developing SpanishTinyRoBERTa, a compressed language model based on RoBERTa for efficient question answering in Spanish. To achieve this, we employ knowledge distillation from a large model onto a lighter model that allows for a wider implementation, even in areas with limited computational resources, whilst attaining negligible performance sacrifice. Our experiments show that the dense distilled model can still preserve the performance of its larger counterpart, while significantly increasing inference speedup. This work serves as a starting point for further research and investigation of model compression efforts for Spanish language models across various NLP tasks.


title: Energy dependent nuclear suppression from gluon saturation in exclusive vector meson production

abstract: We calculate the exclusive $\mathrm{J}/\psi$ photoproduction cross section at high energies from the Color Glass Condensate approach. The results are compared to the center-of-mass energy dependent $\gamma+A\to\mathrm{J}/\psi+A$ cross sections extracted from measurements in ultra peripheral heavy ion collisions at RHIC and LHC. We predict strong saturation-driven nuclear suppression at high energies, while LHC data prefers even stronger suppression. We explore the effect of nucleon shape fluctuations on the nuclear suppression in the coherent and incoherent cross sections, and show that the most recent measurement of the $|t|$-differential incoherent $\mathrm{J}/\psi$ cross section prefers large event-by-event fluctuations of the nucleon substructure in heavy nuclei, comparable to that found for a free proton.


title: Possible gapless helical edge states in hydrogenated graphene

abstract: Electronic band structures in hydrogenated graphene are theoretically investigated by means of first-principle calculations and an effective tight-binding model. It is shown that regularly designed hydrogenation to graphene gives rise to a large band gap about 1 eV. Remarkably, by changing the spatial pattern of the hydrogenation, topologically distinct states can be realized, where the topological nontriviality is detected by $C_2$ parity indices in bulk and confirmed by the existence of gapless edge/interface states as protected by the mirror and sublattice symmetries. The analysis of the wave functions reveals that the helical edge states in hydrogenated graphene with the appropriate design carry pseudospin currents that are reminiscent of the quantum spin Hall effect. Our work shows the potential of hydrogenated graphene in pseudospin-based device applications.


title: On the kernels of the pro-$p$ outer Galois representations associated to once-punctured CM elliptic curves

abstract: In this paper, we compare a certain field arising from the pro-$p$ outer Galois representation associated to a once-punctured CM elliptic curve over an imaginary quadratic field $K$ with the maximal pro-$p$ Galois extension of the mod-$p$ ray class field $K(p)$ of $K$ unramified outside $p$. We prove that these two fields coincide for every prime $p$ which satisfies certain assumptions, assuming an analogue of the Deligne-Ihara conjecture. This may be regarded as an analogue of a result of Sharifi on the kernel of the pro-$p$ outer Galois representation associated to the projective line minus three points.