title: Task-Agnostic Low-Rank Adapters for Unseen English Dialects

abstract: Large Language Models (LLMs) are trained on corpora disproportionally weighted in favor of Standard American English. As a result, speakers of other dialects experience significantly more failures when interacting with these technologies. In practice, these speakers often accommodate their speech to be better understood. Our work shares the belief that language technologies should be designed to accommodate the diversity in English dialects and not the other way around. However, prior works on dialect struggle with generalizing to evolving and emerging dialects in a scalable manner. To fill this gap, our method, HyperLoRA, leverages expert linguistic knowledge to enable resource-efficient adaptation via hypernetworks. By disentangling dialect-specific and cross-dialectal information, HyperLoRA improves generalization to unseen dialects in a task-agnostic fashion. Not only is HyperLoRA more scalable in the number of parameters, but it also achieves the best or most competitive performance across 5 dialects in a zero-shot setting. In this way, our approach facilitates access to language technology for billions of English dialect speakers who are traditionally underrepresented.


title: Floquet engineering in the presence of optically excited carriers

abstract: Floquet engineering provides an optical means to manipulate electronic bandstructures, however, carriers excited by the pump field can lead to an effective heating, and can obscure measurement of the band changes. A recent demonstration of the effects of Floquet engineering on a coherent ensemble of excitons in monolayer WS$_2$ proved particularly sensitive to non-adiabatic effects, while still being able to accurately resolve bandstructure changes. Here, we drive an AC-Stark effect in monolayer WS$_2$ using pulses with constant fluence but varying pulse duration (from 25-235~fs). With shorter pump pulses, the corresponding increase in peak intensity introduces additional carriers via two-photon absorption, leading to additional decoherence and peak broadening (which makes it difficult to resolve the AC-Stark shift). We use multidimensional coherent spectroscopy to create a coherent ensemble of excitons in monolayer WS$_2$ and measure the evolution of the coherence throughout the duration of the Floquet pump pulse. Changes to the amplitude of the macroscopic coherence quantifies the additional broadening. At the same time, the evolution of the average phase allows the instantaneous changes to the bandstructure to be quantified, and is not impacted by the additional broadening. This approach to measuring the evolution of Floquet-Bloch states demonstrates a means to quantify effective heating and non-adiabaticity caused by excited carriers, while at the same time resolving the coherent evolution of the bandstructure.


title: RPCANet: Deep Unfolding RPCA Based Infrared Small Target Detection

abstract: Deep learning (DL) networks have achieved remarkable performance in infrared small target detection (ISTD). However, these structures exhibit a deficiency in interpretability and are widely regarded as black boxes, as they disregard domain knowledge in ISTD. To alleviate this issue, this work proposes an interpretable deep network for detecting infrared dim targets, dubbed RPCANet. Specifically, our approach formulates the ISTD task as sparse target extraction, low-rank background estimation, and image reconstruction in a relaxed Robust Principle Component Analysis (RPCA) model. By unfolding the iterative optimization updating steps into a deep-learning framework, time-consuming and complex matrix calculations are replaced by theory-guided neural networks. RPCANet detects targets with clear interpretability and preserves the intrinsic image feature, instead of directly transforming the detection task into a matrix decomposition problem. Extensive experiments substantiate the effectiveness of our deep unfolding framework and demonstrate its trustworthy results, surpassing baseline methods in both qualitative and quantitative evaluations.


title: Topological edge spectrum along curved interfaces

abstract: We prove that that if the boundary of a topological insulator divides the plane in two regions containing arbitrarily large balls, then it acts as a conductor. Conversely, we show that topological insulators that fit within strips do not need to admit conducting boundary modes.

categories: math-ph cond-mat.mes-hall math.MP math.SP quant-ph


title: MIST: Defending Against Membership Inference Attacks Through Membership-Invariant Subspace Training

abstract: In Member Inference (MI) attacks, the adversary try to determine whether an instance is used to train a machine learning (ML) model. MI attacks are a major privacy concern when using private data to train ML models. Most MI attacks in the literature take advantage of the fact that ML models are trained to fit the training data well, and thus have very low loss on training instances. Most defenses against MI attacks therefore try to make the model fit the training data less well. Doing so, however, generally results in lower accuracy. We observe that training instances have different degrees of vulnerability to MI attacks. Most instances will have low loss even when not included in training. For these instances, the model can fit them well without concerns of MI attacks. An effective defense only needs to (possibly implicitly) identify instances that are vulnerable to MI attacks and avoids overfitting them. A major challenge is how to achieve such an effect in an efficient training process. Leveraging two distinct recent advancements in representation learning: counterfactually-invariant representations and subspace learning methods, we introduce a novel Membership-Invariant Subspace Training (MIST) method to defend against MI attacks. MIST avoids overfitting the vulnerable instances without significant impact on other instances. We have conducted extensive experimental studies, comparing MIST with various other state-of-the-art (SOTA) MI defenses against several SOTA MI attacks. We find that MIST outperforms other defenses while resulting in minimal reduction in testing accuracy.


title: A note on gluing cosilting objects

abstract: Based on the recent work of M. Saorin and A. Zvonoreva of gluing (co)silting objects and L.A. Hugel, R. Laking, J. Stovicek and J. Vitora of mutating (co)silting objects, we first study further on gluing pure-injective cosilting objects in algebraic compactly generated triangulated categories and gluing cosilting complexes in the unbounded derived categories of rings. Then we discuss the compatibility of the gluing method and the mutation operation of cosilting objects.


title: $O(N)$ distributed direct factorization of structured dense matrices using runtime systems

abstract: Structured dense matrices result from boundary integral problems in electrostatics and geostatistics, and also Schur complements in sparse preconditioners such as multi-frontal methods. Exploiting the structure of such matrices can reduce the time for dense direct factorization from $O(N^3)$ to $O(N)$. The Hierarchically Semi-Separable (HSS) matrix is one such low rank matrix format that can be factorized using a Cholesky-like algorithm called ULV factorization. The HSS-ULV algorithm is highly parallel because it removes the dependency on trailing sub-matrices at each HSS level. However, a key merge step that links two successive HSS levels remains a challenge for efficient parallelization. In this paper, we use an asynchronous runtime system PaRSEC with the HSS-ULV algorithm. We compare our work with STRUMPACK and LORAPO, both state-of-the-art implementations of dense direct low rank factorization, and achieve up to 2x better factorization time for matrices arising from a diverse set of applications on up to 128 nodes of Fugaku for similar or better accuracy for all the problems that we survey.


title: Research Team Identification Based on Representation Learning of Academic Heterogeneous Information Network

abstract: Academic networks in the real world can usually be described by heterogeneous information networks composed of multi-type nodes and relationships. Some existing research on representation learning for homogeneous information networks lacks the ability to explore heterogeneous information networks in heterogeneous information networks. It cannot be applied to heterogeneous information networks. Aiming at the practical needs of effectively identifying and discovering scientific research teams from the academic heterogeneous information network composed of massive and complex scientific and technological big data, this paper proposes a scientific research team identification method based on representation learning of academic heterogeneous information networks. The attention mechanism at node level and meta-path level learns low-dimensional, dense and real-valued vector representations on the basis of retaining the rich topological information of nodes in the network and the semantic information based on meta-paths, and realizes effective identification and discovery of scientific research teams and important team members in academic heterogeneous information networks based on maximizing node influence. Experimental results show that our proposed method outperforms the comparative methods.


title: A Review and Roadmap of Deep Causal Model from Different Causal Structures and Representations

abstract: The fusion of causal models with deep learning introducing increasingly intricate data sets, such as the causal associations within images or between textual components, has surfaced as a focal research area. Nonetheless, the broadening of original causal concepts and theories to such complex, non-statistical data has been met with serious challenges. In response, our study proposes redefinitions of causal data into three distinct categories from the standpoint of causal structure and representation: definite data, semi-definite data, and indefinite data. Definite data chiefly pertains to statistical data used in conventional causal scenarios, while semi-definite data refers to a spectrum of data formats germane to deep learning, including time-series, images, text, and others. Indefinite data is an emergent research sphere inferred from the progression of data forms by us. To comprehensively present these three data paradigms, we elaborate on their formal definitions, differences manifested in datasets, resolution pathways, and development of research. We summarize key tasks and achievements pertaining to definite and semi-definite data from myriad research undertakings, present a roadmap for indefinite data, beginning with its current research conundrums. Lastly, we classify and scrutinize the key datasets presently utilized within these three paradigms.


title: The Power of the Senses: Generalizable Manipulation from Vision and Touch through Masked Multimodal Learning

abstract: Humans rely on the synergy of their senses for most essential tasks. For tasks requiring object manipulation, we seamlessly and effectively exploit the complementarity of our senses of vision and touch. This paper draws inspiration from such capabilities and aims to find a systematic approach to fuse visual and tactile information in a reinforcement learning setting. We propose Masked Multimodal Learning (M3L), which jointly learns a policy and visual-tactile representations based on masked autoencoding. The representations jointly learned from vision and touch improve sample efficiency, and unlock generalization capabilities beyond those achievable through each of the senses separately. Remarkably, representations learned in a multimodal setting also benefit vision-only policies at test time. We evaluate M3L on three simulated environments with both visual and tactile observations: robotic insertion, door opening, and dexterous in-hand manipulation, demonstrating the benefits of learning a multimodal policy. Code and videos of the experiments are available at https://sferrazza.cc/m3l_site.


title: Barrier penetration in a discrete basis formalism

abstract: A standard way to solve a Schr\"odinger equation is to discreteize the radial coordinates and apply a numerical method for a differential equation, such as the Runge-Kutta method or the Numerov method. Here I employ a discrete basis formalism based on a finite mesh method as a simpler alternative, with which the numerical computation can be easily implemented by ordinary linear algebra operations. I compare the numerical convergence of the Numerov integration method to the finite mesh method for calculating penetrabilities of a one-dimensional potential barrier, and show that the latter approach has better convergence properties.


title: M2T2: Multi-Task Masked Transformer for Object-centric Pick and Place

abstract: With the advent of large language models and large-scale robotic datasets, there has been tremendous progress in high-level decision-making for object manipulation. These generic models are able to interpret complex tasks using language commands, but they often have difficulties generalizing to out-of-distribution objects due to the inability of low-level action primitives. In contrast, existing task-specific models excel in low-level manipulation of unknown objects, but only work for a single type of action. To bridge this gap, we present M2T2, a single model that supplies different types of low-level actions that work robustly on arbitrary objects in cluttered scenes. M2T2 is a transformer model which reasons about contact points and predicts valid gripper poses for different action modes given a raw point cloud of the scene. Trained on a large-scale synthetic dataset with 128K scenes, M2T2 achieves zero-shot sim2real transfer on the real robot, outperforming the baseline system with state-of-the-art task-specific models by about 19% in overall performance and 37.5% in challenging scenes where the object needs to be re-oriented for collision-free placement. M2T2 also achieves state-of-the-art results on a subset of language conditioned tasks in RLBench. Videos of robot experiments on unseen objects in both real world and simulation are available on our project website https://m2-t2.github.io.


title: Scalable Counterfactual Distribution Estimation in Multivariate Causal Models

abstract: We consider the problem of estimating the counterfactual joint distribution of multiple quantities of interests (e.g., outcomes) in a multivariate causal model extended from the classical difference-in-difference design. Existing methods for this task either ignore the correlation structures among dimensions of the multivariate outcome by considering univariate causal models on each dimension separately and hence produce incorrect counterfactual distributions, or poorly scale even for moderate-size datasets when directly dealing with such multivariate causal model. We propose a method that alleviates both issues simultaneously by leveraging a robust latent one-dimensional subspace of the original high-dimension space and exploiting the efficient estimation from the univariate causal model on such space. Since the construction of the one-dimensional subspace uses information from all the dimensions, our method can capture the correlation structures and produce good estimates of the counterfactual distribution. We demonstrate the advantages of our approach over existing methods on both synthetic and real-world data.


title: Quatro++: Robust Global Registration Exploiting Ground Segmentation for Loop Closing in LiDAR SLAM

abstract: Global registration is a fundamental task that estimates the relative pose between two viewpoints of 3D point clouds. However, there are two issues that degrade the performance of global registration in LiDAR SLAM: one is the sparsity issue and the other is degeneracy. The sparsity issue is caused by the sparse characteristics of the 3D point cloud measurements in a mechanically spinning LiDAR sensor. The degeneracy issue sometimes occurs because the outlier-rejection methods reject too many correspondences, leaving less than three inliers. These two issues have become more severe as the pose discrepancy between the two viewpoints of 3D point clouds becomes greater. To tackle these problems, we propose a robust global registration framework, called \textit{Quatro++}. Extending our previous work that solely focused on the global registration itself, we address the robust global registration in terms of the loop closing in LiDAR SLAM. To this end, ground segmentation is exploited to achieve robust global registration. Through the experiments, we demonstrate that our proposed method shows a higher success rate than the state-of-the-art global registration methods, overcoming the sparsity and degeneracy issues. In addition, we show that ground segmentation significantly helps to increase the success rate for the ground vehicles. Finally, we apply our proposed method to the loop closing module in LiDAR SLAM and confirm that the quality of the loop constraints is improved, showing more precise mapping results. Therefore, the experimental evidence corroborated the suitability of our method as an initial alignment in the loop closing. Our code is available at https://quatro-plusplus.github.io.


title: Effect of Confinement and Topology: 2-TIPS vs MIPS

abstract: 2-TIPS (Two Temperature induced phase separation) refers to the phase separation phenomenon observed in mixtures of active and passive particles which are modelled using scalar activity. The active particles are connected to a thermostat at high temperature while the passive particles are connected to the thermostat at low temperature and the relative temperature difference between "hot" and "cold" particles is taken as the measure of the activity of the non-equilibrium system. The study of such binary mixtures of hot and cold particles under various kinds of confinement is an important problem in many physical and biological processes. The nature and extent of phase separation are heavily influenced by the geometry of confinement, activity, and density of the non-equilibrium binary mixture. Investigating such 3D binary mixtures confined by parallel walls, we observe that, the active and passive particles phase separate, but the extent of phase separation is reduced compared to bulk phase separation at high densities and enhanced at low densities. However, when the binary mixture of active and passive particles is confined inside a spherical cavity, the phase separation is radial for small radii of the confining sphere and the extent of phase separation is higher compared to their bulk counterparts. Confinement leads to interesting properties in the passive(cold) region like enhanced layering and high compression in the direction parallel to the confining wall. In 2D, both the bulk and confined systems of the binary mixture show a significant decrement in the extent of phase separation at higher densities. This observation is attributed to the trapping of active particles inside the passive cluster, which increases with density. similar phase co-existence.


title: Transport evidence for twin-boundary pinning of superconducting vortices in FeSe

abstract: We provide bulk transport evidence for twin-boundary pinning of vortices in FeSe. We measure interlayer resistance in FeSe in magnetic fields and find that, as the field is rotated in the $ab$ plane, the flux-flow resistivity is suppressed when the field direction is parallel to twinning planes. The width of the associated dip in the resistance vs in-plane field direction curve varies as $T^{1/2}B^{-3/4}$, consistent with the creation of kinked vortices near the parallel field geometry.


title: Learning Defect Prediction from Unrealistic Data

abstract: Pretrained models of code, such as CodeBERT and CodeT5, have become popular choices for code understanding and generation tasks. Such models tend to be large and require commensurate volumes of training data, which are rarely available for downstream tasks. Instead, it has become popular to train models with far larger but less realistic datasets, such as functions with artificially injected bugs. Models trained on such data, however, tend to only perform well on similar data, while underperforming on real world programs. In this paper, we conjecture that this discrepancy stems from the presence of distracting samples that steer the model away from the real-world task distribution. To investigate this conjecture, we propose an approach for identifying the subsets of these large yet unrealistic datasets that are most similar to examples in real-world datasets based on their learned representations. Our approach extracts high-dimensional embeddings of both real-world and artificial programs using a neural model and scores artificial samples based on their distance to the nearest real-world sample. We show that training on only the nearest, representationally most similar samples while discarding samples that are not at all similar in representations yields consistent improvements across two popular pretrained models of code on two code understanding tasks. Our results are promising, in that they show that training models on a representative subset of an unrealistic dataset can help us harness the power of large-scale synthetic data generation while preserving downstream task performance. Finally, we highlight the limitations of applying AI models for predicting vulnerabilities and bugs in real-world applications


title: Towards High-quality HDR Deghosting with Conditional Diffusion Models

abstract: High Dynamic Range (HDR) images can be recovered from several Low Dynamic Range (LDR) images by existing Deep Neural Networks (DNNs) techniques. Despite the remarkable progress, DNN-based methods still generate ghosting artifacts when LDR images have saturation and large motion, which hinders potential applications in real-world scenarios. To address this challenge, we formulate the HDR deghosting problem as an image generation that leverages LDR features as the diffusion model's condition, consisting of the feature condition generator and the noise predictor. Feature condition generator employs attention and Domain Feature Alignment (DFA) layer to transform the intermediate features to avoid ghosting artifacts. With the learned features as conditions, the noise predictor leverages a stochastic iterative denoising process for diffusion models to generate an HDR image by steering the sampling process. Furthermore, to mitigate semantic confusion caused by the saturation problem of LDR images, we design a sliding window noise estimator to sample smooth noise in a patch-based manner. In addition, an image space loss is proposed to avoid the color distortion of the estimated HDR results. We empirically evaluate our model on benchmark datasets for HDR imaging. The results demonstrate that our approach achieves state-of-the-art performances and well generalization to real-world images.


title: From O(3) to Cubic CFT: Conformal Perturbation and the Large Charge Sector

abstract: The Cubic CFT can be understood as the O(3) invariant CFT perturbed by a slightly relevant operator. In this paper, we use conformal perturbation theory together with the conformal data of the O(3) vector model to compute the anomalous dimension of scalar bilinear operators of the Cubic CFT. When the $Z_2$ symmetry that flips the signs of $\phi_i$ is gauged, the Cubic model describes a certain phase transition of a quantum dimer model. The scalar bilinear operators are the order parameters of this phase transition. Based on the conformal data of the O(3) CFT, we determine the correction to the critical exponent as $\eta_{*}^{Cubic}-\eta_{*}^{O(3)}\approx -0.0215(49)$. The O(3) data is obtained using the numerical conformal bootstrap method to study all four-point correlators involving the four operators: $v=\phi_i$, $s=\sum_i \phi_i\phi_i$ and the leading scalar operators with O(3) isospin $j=2$ and 4. According to large charge effective theory, the leading operator with charge $Q$ has scaling dimension $\Delta_{Q}=c_{3/2} Q^{3/2}+c_{1/2}Q^{1/2}$. We find a good match with this prediction up to isospin $j=6$ for spin 0 and 2 and measured the coefficients $c_{3/2}$ and $c_{1/2}$.


title: Measurements of charged-particle multiplicity dependence of higher-order net-proton cumulants in $p$+$p$ collisions at $\sqrt{s} =$ 200 GeV from STAR at RHIC

abstract: We report on the charged-particle multiplicity dependence of net-proton cumulant ratios up to sixth order from $\sqrt{s}$ = 200 GeV $p$+$p$ collisions at the Relativistic Heavy Ion Collider (RHIC). The measured ratios $C_{4}/C_{2}$, $C_{5}/C_{1}$, and $C_{6}/C_{2}$ decrease with increased charged-particle multiplicity and rapidity acceptance. Neither the Skellam baselines nor PYTHIA8 calculations account for the observed multiplicity dependence. In addition, the ratios $C_{5}/C_{1}$ and $C_{6}/C_{2}$ approach negative values in the highest-multiplicity events. The negative ratios in the most central p+p collisions at 200 GeV, similar to those observed in central Au+Au 200 GeV collisions, imply the formation of thermalized QCD matter.


title: High-Q two-dimensional photonic crystal nanocavity on glass with an upper glass thin film

abstract: We numerically analyze two-dimensional photonic crystal (PhC) nanocavities on glass with a thin glass film on top of the structure. We investigated a multi-step heterostructure GaAs PhC nanocavity located on glass. We found that covering the structure even with a very-thin glass film efficiently suppresses unwanted polarization mode conversion occurring due to the asymmetric refractive index environment around the PhC. We also uncovered that the glass-covered structure can exhibit a higher Q factor than that observed in the structure symmetrically cladded with thick glass. We point out that the mode mismatch between the PhC nanocavity and modes in the upper glass film largely contributed to the observed Q-factor enhancement. These observations were further analyzed through the comparison among different types of on-glass PhC nanocavites covered with thin glass films. We also discuss that the in-plane structure of the upper glass film is important for additionally enhancing Q factor of the nanocavity.


title: SatBird: Bird Species Distribution Modeling with Remote Sensing and Citizen Science Data

abstract: Biodiversity is declining at an unprecedented rate, impacting ecosystem services necessary to ensure food, water, and human health and well-being. Understanding the distribution of species and their habitats is crucial for conservation policy planning. However, traditional methods in ecology for species distribution models (SDMs) generally focus either on narrow sets of species or narrow geographical areas and there remain significant knowledge gaps about the distribution of species. A major reason for this is the limited availability of data traditionally used, due to the prohibitive amount of effort and expertise required for traditional field monitoring. The wide availability of remote sensing data and the growing adoption of citizen science tools to collect species observations data at low cost offer an opportunity for improving biodiversity monitoring and enabling the modelling of complex ecosystems. We introduce a novel task for mapping bird species to their habitats by predicting species encounter rates from satellite images, and present SatBird, a satellite dataset of locations in the USA with labels derived from presence-absence observation data from the citizen science database eBird, considering summer (breeding) and winter seasons. We also provide a dataset in Kenya representing low-data regimes. We additionally provide environmental data and species range maps for each location. We benchmark a set of baselines on our dataset, including SOTA models for remote sensing tasks. SatBird opens up possibilities for scalably modelling properties of ecosystems worldwide.


title: Magnetic field hysteresis of thermal conductivity in type-I and typy-II superconductors

abstract: This study investigated the magnetic field ($H$) dependence of thermal conductivity ($\kappa$) in type I (Pb) and type II (Nb) superconductors. The $\kappa$ of Nb displayed hysteresis, showing a local minimum during increasing $H$ process but not during decreasing $H$ process. Different magnetic field dependencies were observed in Pb with varying purity: $\kappa$ of 3N-Pb exhibited broad hysteresis, while that of 5N-Pb showed hysteresis similar to 3N-Nb.


title: Bridging the Gap: Addressing Discrepancies in Diffusion Model Training for Classifier-Free Guidance

abstract: Diffusion models have emerged as a pivotal advancement in generative models, setting new standards to the quality of the generated instances. In the current paper we aim to underscore a discrepancy between conventional training methods and the desired conditional sampling behavior of these models. While the prevalent classifier-free guidance technique works well, it's not without flaws. At higher values for the guidance scale parameter $w$, we often get out of distribution samples and mode collapse, whereas at lower values for $w$ we may not get the desired specificity. To address these challenges, we introduce an updated loss function that better aligns training objectives with sampling behaviors. Experimental validation with FID scores on CIFAR-10 elucidates our method's ability to produce higher quality samples with fewer sampling timesteps, and be more robust to the choice of guidance scale $w$. We also experiment with fine-tuning Stable Diffusion on the proposed loss, to provide early evidence that large diffusion models may also benefit from this refined loss function.


title: Accelerated Data-Driven Discovery and Screening of Two-Dimensional Magnets Using Graph Neural Networks

abstract: In this study, we employ Graph Neural Networks (GNNs) to accelerate the discovery of novel 2D magnetic materials which have transformative potential in spintronics applications. Using data from the Materials Project database and the Computational 2D materials database (C2DB), we train three GNN architectures on a dataset of 1190 magnetic monolayers with energy above the convex hull ($E_{\text{hull}}$) less than 0.3 eV/atom. Our Crystal Diffusion Variational Auto Encoder (CDVAE) generates 11,100 candidate crystals. Subsequent training on two Atomistic Line Graph Neural Networks (ALIGNN) achieves a 93$\%$ accuracy in predicting magnetic monolayers and a mean average error of 0.039 eV/atom for $E_{\text{hull}}$ predictions. After narrowing down candidates based on magnetic likelihood and predicted energy, constraining the atom count in the monolayers to five or fewer, and performing dimensionality checks, we identify 190 candidates. These are validated using Density-Functional Theory (DFT) to confirm their magnetic and energetic favorability resulting in 167 magnetic monolayers with $E_{\text{hull}} < 0.3$ eV/atom and a total magnetization of $\geq$ $0.5 \mu_{B}$. Our methodology offers a way to accelerate exploring and predicting potential 2D magnetic materials, contributing to the ongoing computational and experimental efforts aimed at the discovery of new 2D magnets.


title: Dynamic Uploading Scheduling in mmWave-Based Sensor Networks via Mobile Blocker Detection

abstract: The freshness of information, measured as Age of Information (AoI), is critical for many applications in next-generation wireless sensor networks (WSNs). Due to its high bandwidth, millimeter wave (mmWave) communication is seen to be frequently exploited in WSNs to facilitate the deployment of bandwidth-demanding applications. However, the vulnerability of mmWave to user mobility typically results in link blockage and thus postponed real-time communications. In this paper, joint sampling and uploading scheduling in an AoI-oriented WSN working in mmWave band is considered, where a single human blocker is moving randomly and signal propagation paths may be blocked. The locations of signal reflectors and the real-time position of the blocker can be detected via wireless sensing technologies. With the knowledge of blocker motion pattern, the statistics of future wireless channels can be predicted. As a result, the AoI degradation arising from link blockage can be forecast and mitigated. Specifically, we formulate the long-term sampling, uplink transmission time and power allocation as an infinite-horizon Markov decision process (MDP) with discounted cost. Due to the curse of dimensionality, the optimal solution is infeasible. A novel low-complexity solution framework with guaranteed performance in the worst case is proposed where the forecast of link blockage is exploited in a value function approximation. Simulations show that compared with several heuristic benchmarks, our proposed policy, benefiting from the awareness of link blockage, can reduce average cost up to 49.6%.


title: Gaussian Mixture Solvers for Diffusion Models

abstract: Recently, diffusion models have achieved great success in generative tasks. Sampling from diffusion models is equivalent to solving the reverse diffusion stochastic differential equations (SDEs) or the corresponding probability flow ordinary differential equations (ODEs). In comparison, SDE-based solvers can generate samples of higher quality and are suited for image translation tasks like stroke-based synthesis. During inference, however, existing SDE-based solvers are severely constrained by the efficiency-effectiveness dilemma. Our investigation suggests that this is because the Gaussian assumption in the reverse transition kernel is frequently violated (even in the case of simple mixture data) given a limited number of discretization steps. To overcome this limitation, we introduce a novel class of SDE-based solvers called \emph{Gaussian Mixture Solvers (GMS)} for diffusion models. Our solver estimates the first three-order moments and optimizes the parameters of a Gaussian mixture transition kernel using generalized methods of moments in each step during sampling. Empirically, our solver outperforms numerous SDE-based solvers in terms of sample quality in image generation and stroke-based synthesis in various diffusion models, which validates the motivation and effectiveness of GMS. Our code is available at https://github.com/Guohanzhong/GMS.


title: Directional Differentiability of the Metric Projection in Bochner Spaces

abstract: In this paper, we consider the directional differentiability of metric projection and its properties in uniformly convex and uniformly smooth Bochner space Lp(S; X), in which (S, A, mu) is a positive measure space and X is a uniformly convex and uniformly smooth Banach space. Let (arbitrary) A in A with measure of A greater than 0 and define a subspace Lp(A; X) of Lp(S; X), which is considered as a closed and convex subset of Lp(S; X). We first study the properties of the normalized duality mapping in Lp(S; X) and in Lp(A; X). For any c in Lp(A; X) and r > 0, we define a closed ball BA(c; r) in Lp(A; X) and a cylinder CA(c; r) in Lp(S; X) with base BA(c; r). Then, we investigate some optimal properties of the corresponding metric projections P(Lp(A;X)), P(BA(c;r)) and P(CA(c;r)) that include the inverse images, the directional differentiability and the precise solutions of their directional derivatives.


title: Sound Call Graph Construction for Java Object Deserialization

abstract: Object serialization and deserialization is widely used for storing and preserving objects in files, memory, or database as well as for transporting them across machines, enabling remote interaction among processes and many more. This mechanism relies on reflection, a dynamic language that introduces serious challenges for static analyses. Current state-of-the-art call graph construction algorithms does not fully support object serialization/deserialization, i.e., they are unable to uncover the callback methods that are invoked when objects are serialized and deserialized. Since call graphs are a core data structure for multiple type of analysis (e.g., vulnerability detection), an appropriate analysis cannot be performed since the call graph does not capture hidden (vulnerable) paths that occur via callback methods. In this paper, we present Seneca, an approach for handling serialization with improved soundness in the context of call graph construction. Our approach relies on taint analysis and API modeling to construct sound call graphs. We evaluated our approach with respect to soundness, precision, performance, and usefulness in detecting untrusted object deserialization vulnerabilities. Our results show that Seneca can create sound call graphs with respect to serialization features. The resulting call graphs do not incur significant overhead and were shown to be useful for performing identification of vulnerable paths caused by untrusted object deserialization.


title: Stochastic Smoothed Gradient Descent Ascent for Federated Minimax Optimization

abstract: In recent years, federated minimax optimization has attracted growing interest due to its extensive applications in various machine learning tasks. While Smoothed Alternative Gradient Descent Ascent (Smoothed-AGDA) has proved its success in centralized nonconvex minimax optimization, how and whether smoothing technique could be helpful in federated setting remains unexplored. In this paper, we propose a new algorithm termed Federated Stochastic Smoothed Gradient Descent Ascent (FESS-GDA), which utilizes the smoothing technique for federated minimax optimization. We prove that FESS-GDA can be uniformly used to solve several classes of federated minimax problems and prove new or better analytical convergence results for these settings. We showcase the practical efficiency of FESS-GDA in practical federated learning tasks of training generative adversarial networks (GANs) and fair classification.


title: E3 TTS: Easy End-to-End Diffusion-based Text to Speech

abstract: We propose Easy End-to-End Diffusion-based Text to Speech, a simple and efficient end-to-end text-to-speech model based on diffusion. E3 TTS directly takes plain text as input and generates an audio waveform through an iterative refinement process. Unlike many prior work, E3 TTS does not rely on any intermediate representations like spectrogram features or alignment information. Instead, E3 TTS models the temporal structure of the waveform through the diffusion process. Without relying on additional conditioning information, E3 TTS could support flexible latent structure within the given audio. This enables E3 TTS to be easily adapted for zero-shot tasks such as editing without any additional training. Experiments show that E3 TTS can generate high-fidelity audio, approaching the performance of a state-of-the-art neural TTS system. Audio samples are available at https://e3tts.github.io.


title: Study of bulk properties of the system formed in U+U collisions at $\sqrt{s_{\mathrm NN}}$ =~2.12~GeV using JAM model

abstract: The Lanzhou Cooling-Storage-Ring facility is set to conduct experiments involving Uranium-Uranium collisions at the center of mass energies ranging from 2.12 to 2.4 GeV. Our investigation is focused on various bulk observables, which include charged particle multiplicity ($N_{\text{ch}}$), average transverse momentum ($\langle p_{\text{T}}\rangle$), initial eccentricity ($\epsilon_{n}$), and flow harmonics ($v_{n}$), for different orientations of U+U collisions within the range of $0^{\circ} < \theta < 120 ^{\circ}$ at $\sqrt{s_{\mathrm NN}} = 2.12$ GeV ($p_{\mathrm lab}$ = 500 MeV). Among the various collision configurations at this energy, the tip-tip scenario emerged with the highest average charged particle multiplicity, denoted as $\langle N_{\text{ch}} \rangle$. Notably, both the second and third-order eccentricities, $\epsilon_{2,3}$, revealed intricate patterns as they varied with impact parameter across distinct configurations. The tip-tip configuration displayed the most pronounced magnitude of rapidity-odd directed flow ($v_{1}$), whereas the body-body configuration exhibited the least pronounced magnitude. Concerning elliptic flow ($v_{2}$) near mid-rapidity ($\eta < 1.0$), a negative sign is observed for all configurations except for the side-side exhibited a distinctly positive sign. Within the spectrum of configurations, the body-body scenario displayed the highest magnitude of $v_{2}$. For reaction plane correlated triangular flow ($v_{3}$), the body-body configuration emerged with the largest magnitude while the side-side exhibited the smallest magnitude. Our study seeks to establish a fundamental understanding of various U+U collision configurations in preparation for the forthcoming CEE experiment.


title: The Age of Generative AI and AI-Generated Everything

abstract: Generative AI (GAI) has emerged as a significant advancement in artificial intelligence, renowned for its language and image generation capabilities. This paper presents ``AI-Generated Everything'' (AIGX), a concept that extends GAI beyond mere content creation to real-time adaptation and control across diverse technological domains. In networking, AIGX collaborates closely with physical, data link, network, and application layers to enhance real-time network management that responds to various system and service settings as well as application and user requirements. Networks, in return, serve as crucial components in further AIGX capability optimization through the AIGX lifecycle, i.e., data collection, distributed pre-training, and rapid decision-making, thereby establishing a mutually enhancing interplay. Moreover, we offer an in-depth case study focused on power allocation to illustrate the interdependence between AIGX and networking systems. Through this exploration, the article analyzes the significant role of GAI for networking, clarifies the ways networks augment AIGX functionalities, and underscores the virtuous interactive cycle they form. This article paves the way for subsequent future research aimed at fully unlocking the potential of GAI and networks.


title: The generation and detection of the spin-valley-polarization in semi-Dirac materials

abstract: We investigated the transport properties in a normal metal/ferromagnet/normal metal/superconductor junction based on semi-Dirac materials with inverted energy gap. With a scattering matrix approach, we show that the electron transport in the junction is spin-valley-polarized due to the ferromagnetic exchange energy. It is also shown that the Andreev reflection is strongly suppressed, which is a clear experimental signal for the spin-valley-polarization in semi-Dirac materials.


title: POS: A Prompts Optimization Suite for Augmenting Text-to-Video Generation

abstract: This paper targets to enhance the diffusion-based text-to-video generation by improving the two input prompts, including the noise and the text. Accommodated with this goal, we propose POS, a training-free Prompt Optimization Suite to boost text-to-video models. POS is motivated by two observations: (1) Video generation shows instability in terms of noise. Given the same text, different noises lead to videos that differ significantly in terms of both frame quality and temporal consistency. This observation implies that there exists an optimal noise matched to each textual input; To capture the potential noise, we propose an optimal noise approximator to approach the potential optimal noise. Particularly, the optimal noise approximator initially searches a video that closely relates to the text prompt and then inverts it into the noise space to serve as an improved noise prompt for the textual input. (2) Improving the text prompt via LLMs often causes semantic deviation. Many existing text-to-vision works have utilized LLMs to improve the text prompts for generation enhancement. However, existing methods often neglect the semantic alignment between the original text and the rewritten one. In response to this issue, we design a semantic-preserving rewriter to impose contraints in both rewritng and denoising phrases to preserve the semantic consistency. Extensive experiments on popular benchmarks show that our POS can improve the text-to-video models with a clear margin. The code will be open-sourced.


title: A robust version of the multipartite Hajnal--Szemer\'edi theorem

abstract: In this note we show the following strengthening of a multipartite version of the Hajnal--Szemer\'edi theorem. For an integer $r \ge 3$ and $\gamma > 0$, there exists a constant $C$ such that if $p\ge Cn^{-2/r}(\log n)^{1/{r \choose 2}}$ and $G$ is a balanced $r$-partite graph with each vertex class of size $n$ and $\delta^\ast(G)\ge (1-1/r+\gamma)n$, then with high probability the random subgraph $G(p)$ of $G$ contains a $K_r$-factor. We also use it to derive corresponding transversal versions.


title: A Microlocal Analysis of the L\'evy Generator with Conjugate Points

abstract: We analyze the microlocal structure of the infinitesimal generator of a L\'evy process on a closed Riemannian manifold when conjugate points are allowed. We show that if there are no singular conjugate pairs, then the infinitesimal generator can be written as a sum of pseudodifferential operators and Fourier integral operators. This extends and unifies known results for the flat torus, the sphere, and Anosov manifolds.


title: Workspace optimization of 1T2R parallel manipulators with a dimensionally homogeneous constraint-embedded Jacobian

abstract: This paper presents the workspace optimization of one-translational two-rotational (1T2R) parallel manipulators using a dimensionally homogeneous constraint-embedded Jacobian. The mixed degrees of freedom of 1T2R parallel manipulators, which cause dimensional inconsistency, make it difficult to optimize their architectural parameters. To solve this problem, a point-based approach with a shifting property, selection matrix, and constraint-embedded inverse Jacobian is proposed. A simplified formulation is provided, eliminating the complex partial differentiation required in previous approaches. The dimensional homogeneity of the proposed method was analytically proven, and its validity was confirmed by comparing it with the conventional point-based method using a 3-PRS manipulator. Furthermore, the approach was applied to an asymmetric 2-RRS/RRRU manipulator with no parasitic motion. This mechanism has a T-shape combination of limbs with different kinematic parameters, making it challenging to derive a dimensionally homogeneous Jacobian using the conventional method. Finally, optimization was performed, and the results show that the proposed method is more efficient than the conventional approach. The efficiency and simplicity of the proposed method were verified using two distinct parallel manipulators.


title: Blending Reward Functions via Few Expert Demonstrations for Faithful and Accurate Knowledge-Grounded Dialogue Generation

abstract: The development of trustworthy conversational information-seeking systems relies on dialogue models that can generate faithful and accurate responses based on relevant knowledge texts. However, two main challenges hinder this task. Firstly, language models may generate hallucinations due to data biases present in their pretraining corpus. Secondly, knowledge texts often contain redundant and irrelevant information that distracts the model's attention from the relevant text span. Previous works use additional data annotations on the knowledge texts to learn a knowledge identification module in order to bypass irrelevant information, but collecting such high-quality span annotations can be costly. In this work, we leverage reinforcement learning algorithms to overcome the above challenges by introducing a novel reward function. Our reward function combines an accuracy metric and a faithfulness metric to provide a balanced quality judgment of generated responses, which can be used as a cost-effective approximation to a human preference reward model when only a few preference annotations are available. Empirical experiments on two conversational information-seeking datasets demonstrate that our method can compete with other strong supervised learning baselines.


title: On the Free Boundary Problems of 3-D Compressible Euler Equations Coupled or Uncoupled With a Nonlinear Poisson Equation

abstract: For the problem of the non-isentropic compressible Euler Equations coupled with a nonlinear Poisson equation with the electric potential satisfying the Dirichlet boundary condition in three spatial dimensions with a general free boundary not restricting to a graph, we identify suitable stability conditions on the electric potential and the pressure under which we obtain a priori estimates on the Sobolev norms of the fluid and electric variables and bounds for geometric quantities of free surface. The stability conditions in this case for a general variable entropy are that the outer normal derivative of the electric potential is positive on the free surface, whereas that on the pressure is negative. In the isentropic case, the stability condition reduces to a single one, the outer normal derivative of the difference of the enthalpy and the electric potential is negative on the free surface. For the free boundary problem of the non-isentropic compressible Euler equations with variable entropy without coupling with the nonlinear Poisson equation, the corresponding higher-order estimates are also obtained under the Taylor sign condition. It is also found that one less derivative is needed to close the energy estimates for the problem for the non-isentropic compressible Euler Equations coupled with a nonlinear Poisson equation when the electric potential satisfies the Dirichlet boundary condition under the stability conditions on the electric potential and the pressure, compared with the problem of the non-isentropic compressible Euler equations.


title: On stability analysis for steady states of the free boundary hard phase model in general relativity

abstract: The hard phase model describes a relativistic barotropic fluid with sound speed equal to the speed of light. In the framework of general relativity, the motion of the fluid is coupled to the Einstein equations which describe the structure of the underlying spacetime. This model with free boundary admits a $1$-parameter family of steady states with spherical symmetry. In this work, for perturbations within spherical symmetry, we study the stability and instability of this family. We prove that the linearized operator around steady states with large central densities admits a growing mode, while such growing modes do not exist for steady states with small central densities. Based on the linear analysis, we further demonstrate a dynamical nonlinear instability for steady states with large central densities. The proof relies on a spectral analysis of the linearized operator and an a priori estimate on the full nonlinear free boundary problem.


title: Peculiarities for scalar fields in GR domain walls

abstract: In the present letter, the solutions of the Klein Gordon equation in the space time of an infinite domain wall is studied. It is shown that the horizon is an special region, where initial conditions (scattering conditions) at asymptotic past for the field can not be defined. This is in harmony with the fact that this region can not be crossed, a possibility that was suggested in \cite{lanosa}. If these results are correct, then it makes no sense to impose boundary conditions at this location.


title: An equivalent reformulation and multi-proximity gradient algorithms for a class of nonsmooth fractional programming

abstract: In this paper, we consider a class of structured fractional programs, where the numerator part is the sum of a block-separable (possibly nonsmooth nonconvex) function and a locally Lipschitz differentiable (possibly nonconvex) function, while the denominator is a convex (possibly nonsmooth) function. We first present a novel reformulation for the original problem and show the relationship between optimal solutions, critical points and KL exponents of these two problems. Inspired by the reformulation, we propose a flexible framework of multi-proximity gradient algorithms (MPGA), which computes the proximity operator with respect to the Fenchel conjugate associated with the convex denominator of the original problem rather than evaluating its subgradient as in the existing methods. Also, MPGA employs a nonmonotone linear-search scheme in its gradient descent step, since the smooth part in the numerator of the original problem is not globally Lipschitz differentiable. Based on the framework of MPGA, we develop two specific algorithms, namely, cyclic MPGA and randomized MPGA, and establish their subsequential convergence under mild conditions. Moreover, the sequential convergence of cyclic MPGA with the monotone line-search (CMPGA_ML) is guaranteed if the extended objective associated with the reformulated problem satisfies the Kurdyka-{\L}ojasiewicz (KL) property and some other mild assumptions. In particular, we prove that the corresponding KL exponents are 1/2 for several special cases of the fractional programs, and so, CMPGA_ML exhibits a linear convergence rate. Finally, some preliminary numerical experiments are performed to demonstrate the efficiency of our proposed algorithms.


title: IndoToD: A Multi-Domain Indonesian Benchmark For End-to-End Task-Oriented Dialogue Systems

abstract: Task-oriented dialogue (ToD) systems have been mostly created for high-resource languages, such as English and Chinese. However, there is a need to develop ToD systems for other regional or local languages to broaden their ability to comprehend the dialogue contexts in various languages. This paper introduces IndoToD, an end-to-end multi domain ToD benchmark in Indonesian. We extend two English ToD datasets to Indonesian, comprising four different domains by delexicalization to efficiently reduce the size of annotations. To ensure a high-quality data collection, we hire native speakers to manually translate the dialogues. Along with the original English datasets, these new Indonesian datasets serve as an effective benchmark for evaluating Indonesian and English ToD systems as well as exploring the potential benefits of cross-lingual and bilingual transfer learning approaches.


title: Dynamic Fair Federated Learning Based on Reinforcement Learning

abstract: Federated learning enables a collaborative training and optimization of global models among a group of devices without sharing local data samples. However, the heterogeneity of data in federated learning can lead to unfair representation of the global model across different devices. To address the fairness issue in federated learning, we propose a dynamic q fairness federated learning algorithm with reinforcement learning, called DQFFL. DQFFL aims to mitigate the discrepancies in device aggregation and enhance the fairness of treatment for all groups involved in federated learning. To quantify fairness, DQFFL leverages the performance of the global federated model on each device and incorporates {\alpha}-fairness to transform the preservation of fairness during federated aggregation into the distribution of client weights in the aggregation process. Considering the sensitivity of parameters in measuring fairness, we propose to utilize reinforcement learning for dynamic parameters during aggregation. Experimental results demonstrate that our DQFFL outperforms the state-of-the-art methods in terms of overall performance, fairness and convergence speed.


title: Trajectory Similarity Measurement: An Efficiency Perspective

abstract: Trajectories that capture object movement have numerous applications, in which similarity computation between trajectories often plays a key role. Traditionally, the similarity between two trajectories is quantified by means of heuristic measures, e.g., Hausdorff or ERP, that operate directly on the trajectories. In contrast, recent studies exploit deep learning to map trajectories to d-dimensional vectors, called embeddings. Then, some distance measure, e.g., Manhattan or Euclidean, is applied to the embeddings to quantify trajectory similarity. The resulting similarities are inaccurate: they only approximate the similarities obtained using the heuristic measures. As distance computation on embeddings is efficient, focus has been on achieving embeddings yielding high accuracy. Adopting an efficiency perspective, we analyze the time complexities of both the heuristic and the learning-based approaches, finding that the time complexities of the former approaches are not necessarily higher. Through extensive experiments on open datasets, we find that, on both CPUs and GPUs, only a few learning-based approaches can deliver the promised higher efficiency, when the embeddings can be pre-computed, while heuristic approaches are more efficient for one-off computations. Among the learning-based approaches, the self-attention-based ones are the fastest to learn embeddings that also yield the highest accuracy for similarity queries. These results have implications for the use of trajectory similarity approaches given different application requirements.


title: Concatenated Masked Autoencoders as Spatial-Temporal Learner

abstract: Learning representations from videos requires understanding continuous motion and visual correspondences between frames. In this paper, we introduce the Concatenated Masked Autoencoders (CatMAE) as a spatial-temporal learner for self-supervised video representation learning. For the input sequence of video frames, CatMAE keeps the initial frame unchanged while applying substantial masking (95%) to subsequent frames. The encoder in CatMAE is responsible for encoding visible patches for each frame individually; subsequently, for each masked frame, the decoder leverages visible patches from both previous and current frames to reconstruct the original image. Our proposed method enables the model to estimate the motion information between visible patches, match the correspondences between preceding and succeeding frames, and ultimately learn the evolution of scenes. Furthermore, we propose a new data augmentation strategy, Video-Reverse (ViRe), which uses reversed video frames as the model's reconstruction targets. This further encourages the model to utilize continuous motion details and correspondences to complete the reconstruction, thereby enhancing the model's capabilities. Compared to the most advanced pre-training methods, CatMAE achieves a leading level in video segmentation tasks and action recognition tasks.


title: Detecting Generated Images by Real Images Only

abstract: As deep learning technology continues to evolve, the images yielded by generative models are becoming more and more realistic, triggering people to question the authenticity of images. Existing generated image detection methods detect visual artifacts in generated images or learn discriminative features from both real and generated images by massive training. This learning paradigm will result in efficiency and generalization issues, making detection methods always lag behind generation methods. This paper approaches the generated image detection problem from a new perspective: Start from real images. By finding the commonality of real images and mapping them to a dense subspace in feature space, the goal is that generated images, regardless of their generative model, are then projected outside the subspace. As a result, images from different generative models can be detected, solving some long-existing problems in the field. Experimental results show that although our method was trained only by real images and uses 99.9\% less training data than other deep learning-based methods, it can compete with state-of-the-art methods and shows excellent performance in detecting emerging generative models with high inference efficiency. Moreover, the proposed method shows robustness against various post-processing. These advantages allow the method to be used in real-world scenarios.


title: Log canonical thresholds of high multiplicity reduced plane curves

abstract: We compute log canonical thresholds of reduced plane curves of degree $d$ at points of multiplicity $d-1$. As a consequence, we describe all possible values of log canonical threshold that are less than $2/(d-1)$ for reduced plane curves of degree $d$. In addition, we compute log canonical thresholds for all reduced plane curves of degree less than 6.


title: On Finding Bi-objective Pareto-optimal Fraud Prevention Rule Sets for Fintech Applications

abstract: Rules are widely used in Fintech institutions to make fraud prevention decisions, since rules are highly interpretable thanks to their intuitive if-then structure. In practice, a two-stage framework of fraud prevention decision rule set mining is usually employed in large Fintech institutions. This paper is concerned with finding high-quality rule subsets in a bi-objective space (such as precision and recall) from an initial pool of rules. To this end, we adopt the concept of Pareto optimality and aim to find a set of non-dominated rule subsets, which constitutes a Pareto front. We propose a heuristic-based framework called PORS and we identify that the core of PORS is the problem of solution selection on the front (SSF). We provide a systematic categorization of the SSF problem and a thorough empirical evaluation of various SSF methods on both public and proprietary datasets. We also introduce a novel variant of sequential covering algorithm called SpectralRules to encourage the diversity of the initial rule set and we empirically find that SpectralRules further improves the quality of the found Pareto front. On two real application scenarios within Alipay, we demonstrate the advantages of our proposed methodology compared to existing work.


title: On Negative Correlation of Arboreal Gas on Some Graphs

abstract: Arboreal Gas is a type of (unrooted) random forest on a graph, where the probability is determined by a parameter $\beta>0$ per edge. This model is essentially equivalent to acyclic Bernoulli bond percolation with a parameter $p=\beta/(1+\beta)$. Additionally, Arboreal Gas can be considered as the limit of the $q$-states random cluster model with $p=\beta q$ as $q\to 0$. A natural question arises regarding the existence and performance of the weak limit of Arboreal Gas as the graph size goes to infinity. The answer to this question relies on the negative correlation of Arboreal Gas, which is still an open problem. This paper primarily focuses on the negative correlation of Arboreal Gas and provides some results for specific graphs.


title: Invariant-Feature Subspace Recovery: A New Class of Provable Domain Generalization Algorithms

abstract: Domain generalization asks for models trained over a set of training environments to generalize well in unseen test environments. Recently, a series of algorithms such as Invariant Risk Minimization (IRM) have been proposed for domain generalization. However, Rosenfeld et al. (2021) shows that in a simple linear data model, even if non-convexity issues are ignored, IRM and its extensions cannot generalize to unseen environments with less than $d_s+1$ training environments, where $d_s$ is the dimension of the spurious-feature subspace. In this work, we propose Invariant-feature Subspace Recovery (ISR): a new class of algorithms to achieve provable domain generalization across the settings of classification and regression problems. First, in the binary classification setup of Rosenfeld et al. (2021), we show that our first algorithm, ISR-Mean, can identify the subspace spanned by invariant features from the first-order moments of the class-conditional distributions, and achieve provable domain generalization with $d_s+1$ training environments. Our second algorithm, ISR-Cov, further reduces the required number of training environments to $O(1)$ using the information of second-order moments. Notably, unlike IRM, our algorithms bypass non-convexity issues and enjoy global convergence guarantees. Next, we extend ISR-Mean to the more general setting of multi-class classification and propose ISR-Multiclass, which leverages class information and provably recovers the invariant-feature subspace with $\lceil d_s/k\rceil+1$ training environments for $k$-class classification. Finally, for regression problems, we propose ISR-Regression that can identify the invariant-feature subspace with $d_s+1$ training environments. Empirically, we demonstrate the superior performance of our ISRs on synthetic benchmarks. Further, ISR can be used as post-processing methods for feature extractors such as neural nets.


title: Vision-Language Interpreter for Robot Task Planning

abstract: Large language models (LLMs) are accelerating the development of language-guided robot planners. Meanwhile, symbolic planners offer the advantage of interpretability. This paper proposes a new task that bridges these two trends, namely, multimodal planning problem specification. The aim is to generate a problem description (PD), a machine-readable file used by the planners to find a plan. By generating PDs from language instruction and scene observation, we can drive symbolic planners in a language-guided framework. We propose a Vision-Language Interpreter (ViLaIn), a new framework that generates PDs using state-of-the-art LLM and vision-language models. ViLaIn can refine generated PDs via error message feedback from the symbolic planner. Our aim is to answer the question: How accurately can ViLaIn and the symbolic planner generate valid robot plans? To evaluate ViLaIn, we introduce a novel dataset called the problem description generation (ProDG) dataset. The framework is evaluated with four new evaluation metrics. Experimental results show that ViLaIn can generate syntactically correct problems with more than 99\% accuracy and valid plans with more than 58\% accuracy. Our code and dataset are available at https://github.com/omron-sinicx/ViLaIn.


title: Video2Music: Suitable Music Generation from Videos using an Affective Multimodal Transformer model

abstract: Numerous studies in the field of music generation have demonstrated impressive performance, yet virtually no models are able to directly generate music to match accompanying videos. In this work, we develop a generative music AI framework, Video2Music, that can match a provided video. We first curated a unique collection of music videos. Then, we analysed the music videos to obtain semantic, scene offset, motion, and emotion features. These distinct features are then employed as guiding input to our music generation model. We transcribe the audio files into MIDI and chords, and extract features such as note density and loudness. This results in a rich multimodal dataset, called MuVi-Sync, on which we train a novel Affective Multimodal Transformer (AMT) model to generate music given a video. This model includes a novel mechanism to enforce affective similarity between video and music. Finally, post-processing is performed based on a biGRU-based regression model to estimate note density and loudness based on the video features. This ensures a dynamic rendering of the generated chords with varying rhythm and volume. In a thorough experiment, we show that our proposed framework can generate music that matches the video content in terms of emotion. The musical quality, along with the quality of music-video matching is confirmed in a user study. The proposed AMT model, along with the new MuVi-Sync dataset, presents a promising step for the new task of music generation for videos.


title: Breaking transmission symmetry without breaking reciprocity in linear all-dielectric polarization-preserving metagratings

abstract: Transmission asymmetry in reciprocal systems offers an appealing alternative to bulkier non-reciprocal implementations for certain applications. Common reciprocal routes to transmission asymmetry of linearly polarized light involve a rotation of its polarization. Here, we explore a different route with a linear all-dielectric metagrating that preserves polarization, while lacking inversion symmetry along the surface-normal direction. Our all-angle transmission calculations reveal an abrupt transition from a symmetric to an asymmetric transmission response that traces the Bragg critical wavelength of higher-order beam emergence as a function of the incident angle. By adopting an analogy between scattering from a multi-port network and the metagrating paradigm we establish why the only necessary condition for transmission symmetry breaking in this class of systems, is the emergence of any higher-order Bragg diffracted beam. We further show how such a transmission symmetry breaking is consistent with reciprocity and also demonstrate the underpinning symmetry-breaking mechanism with a first-principle numerical experiment. Finally, we elucidate on some previous misconceptions regarding transmission symmetry breaking related to the role of the substrate or need for change of diffraction order number at each interface. Our proposed metagrating can exhibit a strong transmission asymmetry, with contrast that can be as high as ~75%, thus underlining its potential as a blueprint for passive asymmetric or non-linear self-biasing non-reciprocal metasurfaces relevant to integrated and active photonics.


title: Lightweight super resolution network for point cloud geometry compression

abstract: This paper presents an approach for compressing point cloud geometry by leveraging a lightweight super-resolution network. The proposed method involves decomposing a point cloud into a base point cloud and the interpolation patterns for reconstructing the original point cloud. While the base point cloud can be efficiently compressed using any lossless codec, such as Geometry-based Point Cloud Compression, a distinct strategy is employed for handling the interpolation patterns. Rather than directly compressing the interpolation patterns, a lightweight super-resolution network is utilized to learn this information through overfitting. Subsequently, the network parameter is transmitted to assist in point cloud reconstruction at the decoder side. Notably, our approach differentiates itself from lookup table-based methods, allowing us to obtain more accurate interpolation patterns by accessing a broader range of neighboring voxels at an acceptable computational cost. Experiments on MPEG Cat1 (Solid) and Cat2 datasets demonstrate the remarkable compression performance achieved by our method.


title: An Integrated Framework Integrating Monte Carlo Tree Search and Supervised Learning for Train Timetabling Problem

abstract: The single-track railway train timetabling problem (TTP) is an important and complex problem. This article proposes an integrated Monte Carlo Tree Search (MCTS) computing framework that combines heuristic methods, unsupervised learning methods, and supervised learning methods for solving TTP in discrete action spaces. This article first describes the mathematical model and simulation system dynamics of TTP, analyzes the characteristics of the solution from the perspective of MCTS, and proposes some heuristic methods to improve MCTS. This article considers these methods as planners in the proposed framework. Secondly, this article utilizes deep convolutional neural networks to approximate the value of nodes and further applies them to the MCTS search process, referred to as learners. The experiment shows that the proposed heuristic MCTS method is beneficial for solving TTP; The algorithm framework that integrates planners and learners can improve the data efficiency of solving TTP; The proposed method provides a new paradigm for solving TTP.


title: Investigation of the Impact of Magnetic Fields on Scattering Muography Images

abstract: Muography is a non-invasive imaging technique that exploits cosmic-ray muons to probe various targets by analyzing the absorption or scattering of muons. The method is particularly useful for applications ranging from geophysical exploration to security screening, including the identification of nuclear materials. This study leverages both Monte Carlo simulations and the Point of Closest Approach (PoCA) algorithm for image reconstruction to specifically explore the distortions caused by magnetic fields in scattering muography images. In the PoCA algorithm, it is assumed that all scattering of a muon during its travel in material occurs at a single point, known as the PoCA point. Each PoCA point is characterized by a scattering angle, whose distribution provides insights into the density and elemental composition of the target material. However, magnetic fields can influence muon trajectories according to Lorentz law, affecting the estimated positions of the PoCA points and the calculated scattering angles. This introduces challenges in applications such as border security control systems. Moreover, the presence of magnetic fields can lead to what we term "magnetic jamming", where the resulting muography image is distorted or misleading. This effect further complicates the accurate identification and interpretation of target materials. Our findings underline the necessity to account for magnetic field distortions when utilizing scattering muography in practical scenarios.


title: Federated Linear Bandits with Finite Adversarial Actions

abstract: We study a federated linear bandits model, where $M$ clients communicate with a central server to solve a linear contextual bandits problem with finite adversarial action sets that may be different across clients. To address the unique challenges of adversarial finite action sets, we propose the FedSupLinUCB algorithm, which extends the principles of SupLinUCB and OFUL algorithms in linear contextual bandits. We prove that FedSupLinUCB achieves a total regret of $\tilde{O}(\sqrt{d T})$, where $T$ is the total number of arm pulls from all clients, and $d$ is the ambient dimension of the linear model. This matches the minimax lower bound and thus is order-optimal (up to polylog terms). We study both asynchronous and synchronous cases and show that the communication cost can be controlled as $O(d M^2 \log(d)\log(T))$ and $O(\sqrt{d^3 M^3} \log(d))$, respectively. The FedSupLinUCB design is further extended to two scenarios: (1) variance-adaptive, where a total regret of $\tilde{O} (\sqrt{d \sum \nolimits_{t=1}^{T} \sigma_t^2})$ can be achieved with $\sigma_t^2$ being the noise variance of round $t$; and (2) adversarial corruption, where a total regret of $\tilde{O}(\sqrt{dT} + d C_p)$ can be achieved with $C_p$ being the total corruption budget. Experiment results corroborate the theoretical analysis and demonstrate the effectiveness of FedSupLinUCB on both synthetic and real-world datasets.


title: CloudSim Express: A Novel Framework for Rapid Low Code Simulation of Cloud Computing Environments

abstract: Cloud computing environment simulators enable cost-effective experimentation of novel infrastructure designs and management approaches by avoiding significant costs incurred from repetitive deployments in real Cloud platforms. However, widely used Cloud environment simulators compromise on usability due to complexities in design and configuration, along with the added overhead of programming language expertise. Existing approaches attempting to reduce this overhead, such as script-based simulators and Graphical User Interface (GUI) based simulators, often compromise on the extensibility of the simulator. Simulator extensibility allows for customization at a fine-grained level, thus reducing it significantly affects flexibility in creating simulations. To address these challenges, we propose an architectural framework to enable human-readable script-based simulations in existing Cloud environment simulators while minimizing the impact on simulator extensibility. We implement the proposed framework for the widely used Cloud environment simulator, the CloudSim toolkit, and compare it against state-of-the-art baselines using a practical use case. The resulting framework, called CloudSim Express, achieves extensible simulations while surpassing baselines with over a 71.43% reduction in code complexity and an 89.42% reduction in lines of code.


title: Autonomous Learning of Generative Models with Chemical Reaction Network Ensembles

abstract: Can a micron sized sack of interacting molecules autonomously learn an internal model of a complex and fluctuating environment? We draw insights from control theory, machine learning theory, chemical reaction network theory, and statistical physics to develop a general architecture whereby a broad class of chemical systems can autonomously learn complex distributions. Our construction takes the form of a chemical implementation of machine learning's optimization workhorse: gradient descent on the relative entropy cost function. We show how this method can be applied to optimize any detailed balanced chemical reaction network and that the construction is capable of using hidden units to learn complex distributions. This result is then recast as a form of integral feedback control. Finally, due to our use of an explicit physical model of learning, we are able to derive thermodynamic costs and trade-offs associated to this process.

categories: q-bio.MN cs.ET cs.LG cs.NE cs.SY eess.SY physics.bio-ph


title: Spontaneous-Ordering Platoon Control for Multirobot Path Navigation Using Guiding Vector Fields

abstract: In this paper, we propose a distributed guiding-vector-field (DGVF) algorithm for a team of robots to form a spontaneous-ordering platoon moving along a predefined desired path in the n-dimensional Euclidean space. Particularly, by adding a path parameter as an additional virtual coordinate to each robot, the DGVF algorithm can eliminate the singular points where the vector fields vanish, and govern robots to approach a closed and even self-intersecting desired path. Then, the interactions among neighboring robots and a virtual target robot through their virtual coordinates enable the realization of the desired platoon; in particular, relative parametric displacements can be achieved with arbitrary ordering sequences. Rigorous analysis is provided to guarantee the global convergence to the spontaneous-ordering platoon on the common desired path from any initial positions. 2D experiments using three HUSTER-0.3 unmanned surface vessels (USVs) are conducted to validate the practical effectiveness of the proposed DGVF algorithm, and 3D numerical simulations are presented to demonstrate its effectiveness and robustness when tackling higher-dimensional multi-robot path-navigation missions and some robots breakdown.


title: Optimal external forces of the lock-in phenomena for the flow past inclined plate in a uniform flow

abstract: We theoretically studied the optimal control, frequency lock-in, and phase lock-in phenomena due to the spatially localized periodic forcing in the flow past the inclined plate. Although frequency lock-in is evident in many fluid phenomena, especially fluid-structure interactions, not many researchers have investigated it using a theoretical approach based on flow details. We obtained detailed information on the lock-in phenomena to external periodic forcing using phase reduction theory, a mathematical method for extracting the dynamics near the limit cycle. Furthermore, the optimal forces applied to the velocity field were determined under the condition of the minimum forcing energy and maximum lock-in range. The study of uniform periodic forces applied within spatially confined regions led us to conclude that the effective lock-in position, which includes both the upstream and downstream areas of the plate, depends on the principal frequency of the force. The frequency lock-in range of these forces was analyzed and compared with theoretical predictions.


title: Cooperative Label-Free Moving Target Fencing for Second-Order Multi-Agent Systems with Rigid Formation

abstract: This paper proposes a label-free controller for a second-order multi-agent system to cooperatively fence a moving target of variational velocity into a convex hull formed by the agents whereas maintaining a rigid formation. Therein, no label is predetermined for a specified agent. To attain a rigid formation with guaranteed collision avoidance, each controller consists of two terms: a dynamic regulator with an internal model to drive agents towards the moving target merely by position information feedback, and a repulsive force between each pair of adjacent agents. Significantly, sufficient conditions are derived to guarantee the asymptotic stability of the closed-loop systems governed by the proposed fencing controller. Rigorous analysis is provided to eliminate the strong nonlinear couplings induced by the label-free property. Finally, the effectiveness of the controller is substantiated by numerical simulations.


title: Overhead Line Defect Recognition Based on Unsupervised Semantic Segmentation

abstract: Overhead line inspection greatly benefits from defect recognition using visible light imagery. Addressing the limitations of existing feature extraction techniques and the heavy data dependency of deep learning approaches, this paper introduces a novel defect recognition framework. This is built on the Faster RCNN network and complemented by unsupervised semantic segmentation. The approach involves identifying the type and location of the target equipment, utilizing semantic segmentation to differentiate between the device and its backdrop, and finally employing similarity measures and logical rules to categorize the type of defect. Experimental results indicate that this methodology focuses more on the equipment rather than the defects when identifying issues in overhead lines. This leads to a notable enhancement in accuracy and exhibits impressive adaptability. Thus, offering a fresh perspective for automating the inspection of distribution network equipment.


title: MAAIG: Motion Analysis And Instruction Generation

abstract: Many people engage in self-directed sports training at home but lack the real-time guidance of professional coaches, making them susceptible to injuries or the development of incorrect habits. In this paper, we propose a novel application framework called MAAIG(Motion Analysis And Instruction Generation). It can generate embedding vectors for each frame based on user-provided sports action videos. These embedding vectors are associated with the 3D skeleton of each frame and are further input into a pretrained T5 model. Ultimately, our model utilizes this information to generate specific sports instructions. It has the capability to identify potential issues and provide real-time guidance in a manner akin to professional coaches, helping users improve their sports skills and avoid injuries.


title: Fast generation of mock galaxy catalogues with COLA

abstract: We investigate the feasibility of using COmoving Lagrangian Acceleration (COLA) technique to efficiently generate galaxy mock catalogues that can accurately reproduce the statistical properties of observed galaxies. Our proposed scheme combines the subhalo abundance matching (SHAM) procedure with COLA simulations, utilizing only three free parameters: the scatter magnitude ($\sigma_{\rm scat}$) in SHAM, the initial redshift ($z_{\rm init}$) of the COLA simulation, and the time stride ($da$) used by COLA. In this proof-of-concept study, we focus on a subset of BOSS CMASS NGC galaxies within the redshift range $z\in [0.45, 0.55]$. We perform $\mathtt{GADGET}$ simulation and low-resolution COLA simulations with various combinations of $(z_{\rm init}, da)$, each using $1024^{3}$ particles in an $800~h^{-1}{\rm Mpc}$ box. By minimizing the difference between COLA mock and CMASS NGC galaxies for the monopole of the two-point correlation function (2PCF), we obtain the optimal $\sigma_{\rm scat}$. We have found that by setting $z_{\rm init}=29$ and $da=1/30$, we achieve a good agreement between COLA mock and CMASS NGC galaxies within the range of 4 to $20~h^{-1}{\rm Mpc}$, with a computational cost two orders of magnitude lower than that of the N-body code. Moreover, a detailed verification is performed by comparing various statistical properties, such as anisotropic 2PCF, three-point clustering, and power spectrum multipoles, which shows similar performance between GADGET mock and COLA mock catalogues with the CMASS NGC galaxies. Furthermore, we assess the robustness of the COLA mock catalogues across different cosmological models, demonstrating consistent results in the resulting 2PCFs. Our findings suggest that COLA simulations are a promising tool for efficiently generating mock catalogues for emulators and machine learning analyses in exploring the large-scale structure of the Universe.


title: The c-differential properties of a class of power functions

abstract: Power functions with low $c$-differential uniformity have been widely studied not only because of their strong resistance to multiplicative differential attacks, but also low implementation cost in hardware. Furthermore, the $c$-differential spectrum of a function gives a more precise characterization of its $c$-differential properties. Let $f(x)=x^{\frac{p^n+3}{2}}$ be a power function over the finite field $\mathbb{F}_{p^{n}}$, where $p\neq3$ is an odd prime and $n$ is a positive integer. In this paper, for all primes $p\neq3$, by investigating certain character sums with regard to elliptic curves and computing the number of solutions of a system of equations over $\mathbb{F}_{p^{n}}$, we determine explicitly the $(-1)$-differential spectrum of $f$ with a unified approach. We show that if $p^n \equiv 3 \pmod 4$, then $f$ is a differentially $(-1,3)$-uniform function except for $p^n\in\{7,19,23\}$ where $f$ is an APcN function, and if $p^n \equiv 1 \pmod 4$, the $(-1)$-differential uniformity of $f$ is equal to $4$. In addition, an upper bound of the $c$-differential uniformity of $f$ is also given.


title: Optimizing Inventory Routing: A Decision-Focused Learning Approach using Neural Networks

abstract: Inventory Routing Problem (IRP) is a crucial challenge in supply chain management as it involves optimizing efficient route selection while considering the uncertainty of inventory demand planning. To solve IRPs, usually a two-stage approach is employed, where demand is predicted using machine learning techniques first, and then an optimization algorithm is used to minimize routing costs. Our experiment shows machine learning models fall short of achieving perfect accuracy because inventory levels are influenced by the dynamic business environment, which, in turn, affects the optimization problem in the next stage, resulting in sub-optimal decisions. In this paper, we formulate and propose a decision-focused learning-based approach to solving real-world IRPs. This approach directly integrates inventory prediction and routing optimization within an end-to-end system potentially ensuring a robust supply chain strategy.

categories: cs.LG cs.AI cs.SY eess.SY math.OC stat.ML


title: Inclusiveness Matters: A Large-Scale Analysis of User Feedback

abstract: In an era of rapidly expanding software usage, catering to the diverse needs of users from various backgrounds has become a critical challenge. Inclusiveness, representing a core human value, is frequently overlooked during software development, leading to user dissatisfaction. Users often engage in discourse on online platforms where they indicate their concerns. In this study, we leverage user feedback from three popular online sources, Reddit, Google Play Store, and Twitter, for 50 of the most popular apps in the world to reveal the inclusiveness-related concerns from end users. Using a Socio-Technical Grounded Theory approach, we analyzed 23,107 posts across the three sources and identified 1,211 inclusiveness related posts. We organize our empirical results in a taxonomy for inclusiveness comprising 6 major categories: Fairness, Technology, Privacy, Demography, Usability, and Other Human Values. To explore automated support to identifying inclusiveness-related posts, we experimented with five state-of-the-art pre-trained large language models (LLMs) and found that these models' effectiveness is high and yet varied depending on the data source. GPT-2 performed best on Reddit, BERT on the Google Play Store, and BART on Twitter. Our study provides an in-depth view of inclusiveness-related user feedback from most popular apps and online sources. We provide implications and recommendations that can be used to bridge the gap between user expectations and software so that software developers can resonate with the varied and evolving needs of the wide spectrum of users.


title: Explicit bound for singularities on toric fibrations

abstract: It was conjectured by McKernan and Shokurov that for any Fano contraction $f:X \to Z$ of relative dimension $r$ with $X$ being $\epsilon$-lc, there is a positive $\delta$ depending only on $r,\epsilon$ such that $Z$ is $\delta$-lc and the multiplicity of the fiber of $f$ over a codimension one point of $Z$ is bounded above by $1/\delta$. Recently, this conjecture was confirmed by Birkar. In this paper, we give an explicit value for $\delta$ in terms of $\epsilon,r$ in the toric case, which belongs to $O(\epsilon^{2^r})$ as $\epsilon \to 0$. When $r=2$, the order $O(\epsilon^4)$ is optimal by an example given by Alexeev and Borisov.


title: M&M3D: Multi-Dataset Training and Efficient Network for Multi-view 3D Object Detection

abstract: In this research, I proposed a network structure for multi-view 3D object detection using camera-only data and a Bird's-Eye-View map. My work is based on a current key challenge domain adaptation and visual data transfer. Although many excellent camera-only 3D object detection has been continuously proposed, many research work risk dramatic performance drop when the networks are trained on the source domain but tested on a different target domain. Then I found it is very surprising that predictions on bounding boxes and classes are still replied to on 2D networks. Based on the domain gap assumption on various 3D datasets, I found they still shared a similar data extraction on the same BEV map size and camera data transfer. Therefore, to analyze the domain gap influence on the current method and to make good use of 3D space information among the dataset and the real world, I proposed a transfer learning method and Transformer construction to study the 3D object detection on NuScenes-mini and Lyft. Through multi-dataset training and a detection head from the Transformer, the network demonstrated good data migration performance and efficient detection performance by using 3D anchor query and 3D positional information. Relying on only a small amount of source data and the existing large model pre-training weights, the efficient network manages to achieve competitive results on the new target domain. Moreover, my study utilizes 3D information as available semantic information and 2D multi-view image features blending into the visual-language transfer design. In the final 3D anchor box prediction and object classification, my network achieved good results on standard metrics of 3D object detection, which differs from dataset-specific models on each training domain without any fine-tuning.


title: CML-MOTS: Collaborative Multi-task Learning for Multi-Object Tracking and Segmentation

abstract: The advancement of computer vision has pushed visual analysis tasks from still images to the video domain. In recent years, video instance segmentation, which aims to track and segment multiple objects in video frames, has drawn much attention for its potential applications in various emerging areas such as autonomous driving, intelligent transportation, and smart retail. In this paper, we propose an effective framework for instance-level visual analysis on video frames, which can simultaneously conduct object detection, instance segmentation, and multi-object tracking. The core idea of our method is collaborative multi-task learning which is achieved by a novel structure, named associative connections among detection, segmentation, and tracking task heads in an end-to-end learnable CNN. These additional connections allow information propagation across multiple related tasks, so as to benefit these tasks simultaneously. We evaluate the proposed method extensively on KITTI MOTS and MOTS Challenge datasets and obtain quite encouraging results.


title: Using Augmented Reality to Assess and Modify Mobile Manipulator Surface Repair Plans

abstract: Industrial robotics are redefining inspection and maintenance routines across multiple sectors, enhancing safety, efficiency, and environmental sustainability. In outdoor industrial facilities, it is crucial to inspect and repair complex surfaces affected by corrosion. To address this challenge, mobile manipulators have been developed to navigate these facilities, identify corroded areas, and apply protective coatings. However, given that this technology is still in its infancy and the consequences of improperly coating essential equipment can be significant, human oversight is necessary to review the robot's corrosion identification and repair plan. We present a practical and scalable Augmented Reality (AR)-based system designed to empower non-experts to visualize, modify, and approve robot-generated surface corrosion repair plans in real-time. Built upon an AR-based human-robot interaction framework, Augmented Robot Environment (AugRE), we developed a comprehensive AR application module called Situational Task Accept and Repair (STAR). STAR allows users to examine identified corrosion images, point cloud data, and robot navigation objectives overlaid on the physical environment within these industrial environments. Users are able to additionally make adjustments to the robot repair plan in real-time using interactive holographic volumes, excluding critical nearby equipment that might be at risk of coating overspray. We demonstrate the entire system using a Microsoft HoloLens 2 and a dual-arm mobile manipulator. Our future research will focus on evaluating user experience, system robustness, and real-world validation.


title: A Frobenius Version of Tians Alpha-Invariant

abstract: For a pair (X,L) consisting of a projective variety X over a perfect field of characteristic p>0 and an ample line bundle L on X, we introduce and study a positive characteristic analog of the $\alpha$-invariant introduced by Tian, which we call the $\alpha_F$-invariant. We utilize the theory of F-singularities in positive characteristics, and our approach is based on replacing klt singularities with the closely related notion of global F-regularity. We show that the $\alpha_F$-invariant of a pair (X,L) can be understood in terms of the global Frobenius splittings of the linear systems |mL|, for m>0. We establish inequalities relating the $\alpha_F$-invariant with the F- signature, and use that to prove the positivity of the $\alpha_F$-invariant for all globally F-regular projective varieties (with respect to any ample L on X). When X is a Fano variety and L is $-K_X$, we prove that the $\alpha_F$-invariant of X is always bounded above by 1/2 and establish tighter comparisons with the F-signature. We also show that for toric Fano varieties, the $\alpha_F$-invariant matches with the usual (complex) $\alpha$-invariant. Finally, we prove that the $\alpha_F$-invariant is lower semicontinuous in a family of globally F-regular Fano varieties.


title: VideoDreamer: Customized Multi-Subject Text-to-Video Generation with Disen-Mix Finetuning

abstract: Customized text-to-video generation aims to generate text-guided videos with customized user-given subjects, which has gained increasing attention recently. However, existing works are primarily limited to generating videos for a single subject, leaving the more challenging problem of customized multi-subject text-to-video generation largely unexplored. In this paper, we fill this gap and propose a novel VideoDreamer framework. VideoDreamer can generate temporally consistent text-guided videos that faithfully preserve the visual features of the given multiple subjects. Specifically, VideoDreamer leverages the pretrained Stable Diffusion with latent-code motion dynamics and temporal cross-frame attention as the base video generator. The video generator is further customized for the given multiple subjects by the proposed Disen-Mix Finetuning and Human-in-the-Loop Re-finetuning strategy, which can tackle the attribute binding problem of multi-subject generation. We also introduce MultiStudioBench, a benchmark for evaluating customized multi-subject text-to-video generation models. Extensive experiments demonstrate the remarkable ability of VideoDreamer to generate videos with new content such as new events and backgrounds, tailored to the customized multiple subjects. Our project page is available at https://videodreamer23.github.io/.


title: IR-UWB Radar-based Situational Awareness System for Smartphone-Distracted Pedestrians

abstract: With the widespread adoption of smartphones, ensuring pedestrian safety on roads has become a critical concern due to smartphone distraction. This paper proposes a novel and real-time assistance system called UWB-assisted Safe Walk (UASW) for obstacle detection and warns users about real-time situations. The proposed method leverages Impulse Radio Ultra-Wideband (IR-UWB) radar embedded in the smartphone, which provides excellent range resolution and high noise resilience using short pulses. We implemented UASW specifically for Android smartphones with IR-UWB connectivity. The framework uses complex Channel Impulse Response (CIR) data to integrate rule-based obstacle detection with artificial neural network (ANN) based obstacle classification. The performance of the proposed UASW system is analyzed using real-time collected data. The results show that the proposed system achieves an obstacle detection accuracy of up to 97% and obstacle classification accuracy of up to 95% with an inference delay of 26.8 ms. The results highlight the effectiveness of UASW in assisting smartphone-distracted pedestrians and improving their situational awareness.


title: Computing random $r$-orthogonal Latin squares

abstract: Two Latin squares of order $n$ are $r$-orthogonal if, when superimposed, there are exactly $r$ distinct ordered pairs. The spectrum of all values of $r$ for Latin squares of order $n$ is known. A Latin square $A$ of order $n$ is $r$-self-orthogonal if $A$ and its transpose are $r$-orthogonal. The spectrum of all values of $r$ is known for all orders $n\ne 14$. We develop randomized algorithms for computing pairs of $r$-orthogonal Latin squares of order $n$ and algorithms for computing $r$-self-orthogonal Latin squares of order $n$.