title: Giant graviton expansions for line operator index

abstract: We discuss giant graviton expansions for the Schur index of ${\cal N}=4$ $U(N)$ SYM with the insertion of Wilson lines of the fundamental and the anti-fundamental representations. We first propose a double-sum giant graviton expansion and numerically confirm that it correctly reproduces the line-operator index. We also find that it reduces to a simple-sum expansion when we treat the index as a Taylor series with respect to a specific fugacity.


title: RL in Markov Games with Independent Function Approximation: Improved Sample Complexity Bound under the Local Access Model

abstract: Efficiently learning equilibria with large state and action spaces in general-sum Markov games while overcoming the curse of multi-agency is a challenging problem. Recent works have attempted to solve this problem by employing independent linear function classes to approximate the marginal $Q$-value for each agent. However, existing sample complexity bounds under such a framework have a suboptimal dependency on the desired accuracy $\varepsilon$ or the action space. In this work, we introduce a new algorithm, Lin-Confident-FTRL, for learning coarse correlated equilibria (CCE) with local access to the simulator, i.e., one can interact with the underlying environment on the visited states. Up to a logarithmic dependence on the size of the state space, Lin-Confident-FTRL learns $\epsilon$-CCE with a provable optimal accuracy bound $O(\epsilon^{-2})$ and gets rids of the linear dependency on the action space, while scaling polynomially with relevant problem parameters (such as the number of agents and time horizon). Moreover, our analysis of Linear-Confident-FTRL generalizes the virtual policy iteration technique in the single-agent local planning literature, which yields a new computationally efficient algorithm with a tighter sample complexity bound when assuming random access to the simulator.


title: First-order factors of linear Mahler operators

abstract: We develop and compare two algorithms for computing first-order right-hand factors in the ring of linear Mahler operators$\ell_r M^r + \dots + \ell_1 M + \ell_0$where $\ell_0, \dots, \ell_r$ are polynomials in~$x$ and $Mx = x^b M$ for some integer $b \geq 2$. In other words, we give algorithms for finding all formal infinite product solutions of linear functional equations$\ell_r(x) f(x^{b^r}) + \dots + \ell_1(x) f(x^b) + \ell_0(x) f(x) = 0$. The first of our algorithms is adapted from Petkov\v{s}ek's classical algorithm forthe analogous problem in the case of linear recurrences. The second one proceeds by computing a basis of generalized power series solutions of the functional equation and by using Hermite-Pad{\'e} approximants to detect those linear combinations of the solutions that correspond to first-order factors. We present implementations of both algorithms and discuss their use in combination with criteria from the literature to prove the differential transcendence of power series solutions of Mahler equations.


title: Norm-induced Cuts: Optimization with Lipschitzian Black-box Functions

abstract: In this paper, we consider a finite dimensional optimization problem minimizing a continuous objective on a compact domain subject to a multi-dimensional constraint function. For the latter, we only assume the availability of a Lipschitz property. In recent literature methods based on non-convex outer approximation are proposed for tackling one dimensional equality constraints on bounded polyhedral domains, which are Lipschitz with respect to the maximum norm. To the best of our knowledge, however, there exists no non-convex outer approximation method for a general problem class. We introduce a meta-level solution framework to solve such problems and tackle the underlying theoretical foundations. Considering the feasible domain without the constraint function as manageable, our method relaxes the multidimensional constraint and iteratively refines the feasible region by means of norm-induced cuts, relying on an oracle for the resulting sub-problems. We show the method's correctness and investigate the problem complexity. In order to account for discussions about functionality, limits, and extensions, we present computational examples including illustrations.


title: Photoneutron cross section measurements on $^{208}$Pb in the Giant Dipole Resonance region

abstract: Photoneutron reactions on $^{208}$Pb in the Giant Dipole Resonance energy region have been investigated at the $\gamma$-ray beam line of the NewSUBARU facility in Japan. The measurements made use of quasi-monochromatic laser Compton backscattering $\gamma$-ray beams in a broad energy range, from the neutron threshold up to 38 MeV, and of a flat-efficiency moderated $^3$He neutron detection system along with associated neutron-multiplicity sorting methods. We report absolute cross sections and mean photoneutron energies for the $^{208}$Pb$(\gamma,\,inX)$ reactions with $i$~=~1 to 4. The fine structure present in the $^{208}$Pb$(\gamma,\,n)$ cross sections at incident energies lower than 13~MeV has been observed. The photoabsorption cross section has been obtained as the sum of the $(\gamma,\,inX)$ reaction cross sections. By reproducing the measured ring-ratio values at excitation energies below the two neutron separation energy, we were able to extract estimations on the $^{208}$Pb$(\gamma,\,n)$ photoneutron energy spectra and on the partial photoneutron cross sections for leaving the residual $^{207}$Pb in its ground and first two excited states. The present results are compared with data from the literature and statistical model calculations.


title: Adiabatic Bottlenecks in Quantum Annealing and Nonequilibrium Dynamics of Paramagnons

abstract: The correspondence between long-range interacting quantum spin glasses and combinatorial optimization problems underpins the physical motivation for adiabatic quantum computing. On one hand, in disordered (quantum) spin systems, the focus is on exact methods such as the replica trick that allow the calculation of system quantities in the limit of infinite system and ensemble size. On the other hand, when solving a given instance of an optimization problem, disorder-averaged quantities are of no relevance, as one is solely interested in instance-specific, finite-size properties, in particular the true solution. Here, we apply the nonequilibrium Green-function formalism to the spin coherent-state path integral to obtain the statistical fluctuations and the collective-excitation spectrum along the annealing path. For the example of the quantum Sherrington-Kirkpatrick spin glass, by comparing to extensive numerically exact results, we show that this method provides access to the instance-specific bottlenecks of the annealing protocol.


title: Boosting Continual Learning of Vision-Language Models via Mixture-of-Experts Adapters

abstract: Continual learning can empower vision-language models to continuously acquire new knowledge, without the need for access to the entire historical dataset. However, mitigating the performance degradation in large-scale models is non-trivial due to (i) parameter shifts throughout lifelong learning and (ii) significant computational burdens associated with full-model tuning. In this work, we present a parameter-efficient continual learning framework to alleviate long-term forgetting in incremental learning with vision-language models. Our approach involves the dynamic expansion of a pre-trained CLIP model, through the integration of Mixture-of-Experts (MoE) adapters in response to new tasks. To preserve the zero-shot recognition capability of vision-language models, we further introduce a Distribution Discriminative Auto-Selector (DDAS) that automatically routes in-distribution and out-of-distribution inputs to the MoE Adapter and the original CLIP, respectively. Through extensive experiments across various settings, our proposed method consistently outperforms previous state-of-the-art approaches while concurrently reducing parameter training burdens by 60%. Our code locates at https://github.com/JiazuoYu/MoE-Adapters4CL


title: TARN-VIST: Topic Aware Reinforcement Network for Visual Storytelling

abstract: As a cross-modal task, visual storytelling aims to generate a story for an ordered image sequence automatically. Different from the image captioning task, visual storytelling requires not only modeling the relationships between objects in the image but also mining the connections between adjacent images. Recent approaches primarily utilize either end-to-end frameworks or multi-stage frameworks to generate relevant stories, but they usually overlook latent topic information. In this paper, in order to generate a more coherent and relevant story, we propose a novel method, Topic Aware Reinforcement Network for VIsual StoryTelling (TARN-VIST). In particular, we pre-extracted the topic information of stories from both visual and linguistic perspectives. Then we apply two topic-consistent reinforcement learning rewards to identify the discrepancy between the generated story and the human-labeled story so as to refine the whole generation process. Extensive experimental results on the VIST dataset and human evaluation demonstrate that our proposed model outperforms most of the competitive models across multiple evaluation metrics.


title: New Constructions of Reversible DNA Codes

abstract: DNA codes have many applications, such as in data storage, DNA computing, etc. Good DNA codes have large sizes and satisfy some certain constraints. In this paper, we present a new construction method for reversible DNA codes. We show that the DNA codes obtained using our construction method can satisfy some desired constraints and the lower bounds of the sizes of some DNA codes are better than the known results. We also give new lower bounds on the sizes of some DNA codes of lengths $80$, $96$ and $160$ for some fixed Hamming distance $d$.


title: LLM3:Large Language Model-based Task and Motion Planning with Motion Failure Reasoning

abstract: Conventional Task and Motion Planning (TAMP) approaches rely on manually crafted interfaces connecting symbolic task planning with continuous motion generation. These domain-specific and labor-intensive modules are limited in addressing emerging tasks in real-world settings. Here, we present LLM^3, a novel Large Language Model (LLM)-based TAMP framework featuring a domain-independent interface. Specifically, we leverage the powerful reasoning and planning capabilities of pre-trained LLMs to propose symbolic action sequences and select continuous action parameters for motion planning. Crucially, LLM^3 incorporates motion planning feedback through prompting, allowing the LLM to iteratively refine its proposals by reasoning about motion failure. Consequently, LLM^3 interfaces between task planning and motion planning, alleviating the intricate design process of handling domain-specific messages between them. Through a series of simulations in a box-packing domain, we quantitatively demonstrate the effectiveness of LLM^3 in solving TAMP problems and the efficiency in selecting action parameters. Ablation studies underscore the significant contribution of motion failure reasoning to the success of LLM^3. Furthermore, we conduct qualitative experiments on a physical manipulator, demonstrating the practical applicability of our approach in real-world settings.


title: High-Fidelity Entangling Gates for Electron and Nuclear Spin Qubits in Diamond

abstract: Motivated by the recent experimental progress in exploring the use of a nitrogen-vacancy (NV) center in diamond as a quantum computing platform, we propose schemes for fast and high-fidelity entangling gates on this platform. Using both analytical and numerical calculations, we demonstrate that synchronization effects between resonant and off-resonant transitions may be exploited such that spin-flip errors due to strong driving may be eliminated by adjusting the gate time or the driving field. This allows for fast, high fidelity entangling operations between the electron spin and one or several nuclear spins. We investigate a two-qubit system where the NV center is comprised of a $^{15}$N atom and a qubit-qutrit system for the case of a $^{14}$N atom. In both cases, we predict a complete suppression of off-resonant driving errors for two-qubit gates when addressing the NV electron spin conditioned on states of nuclear spins of the nitrogen atom of the defect. Additionally, we predict fidelities $>0.99$ for multi-qubit gates when including the surrounding $^{13}$C atoms in the diamond lattice in the conditioned logic.


title: Thiol-amine co-solvents aided direct synthesis of ZnTe thin films by spin coating for low cost optoelectronic applications

abstract: Zinc telluride (ZnTe) thin films have special semiconducting characteristics that make them very promising for a broad range of optoelectronic applications. In this work, a novel approach for synthesizing ZnTe thin films by spin coating technique is followed using a unique solution process with ZnTe directly dissolving in thiol-amine co-solvents. Thin films are synthesized on glass substrates and air annealed at 250-350 {\deg}C. The polycrystalline phase of ZnTe is revealed through the X-ray diffraction (XRD) study. The scanning electron microscopy (SEM) is used to observe the evolution of surface smoothness with annealing temperature. Moreover, elemental compositions of ZnTe thin film have been determined by energy dispersive spectroscopy (EDS) study. FTIR spectroscopy reveals that ZnTe has been successfully synthesized as confirmed by the characteristic peaks in the spectrum of 750-1000 cm-1. Optical properties of the ZnTe thin films have been investigated using UV-vis spectroscopy. The transmittance of the films increases with annealing temperature. Furthermore, the optical bandgaps of the films of 2.92, 2.84, and 2.5 eV have been found at 250, 300, and 350 {\deg}C annealing temperatures, respectively. These results suggest that controlling the annealing environment serves as a valuable strategy for tailoring the ZnTe film properties to meet specific application requirements. These results reveal that spin coated ZnTe thin films are attractive ones for various applications in optoelectronic devices such as solar cells and photodetectors.


title: Upper Bounds of the Odd Chromatic Number of a Graph in terms of its Thickness

abstract: An odd coloring of a graph $G$ is a proper vertex coloring $\varphi$ with the property that for each non-isolated vertex $v\in V(G)$, there exists a color $c$ such that the cardinality of $\varphi^{-1}(c)\cap N(v)$ is odd. The concept of odd colorings is introduced by Petru\v{s}evski and \v{S}krekovski. In this paper, we investigate upper bounds of the odd chromatic number of a graph in terms of its thickness and other graphical parameters. In particular, we show that a graph $G$ with the minimum degree at least $2\theta(G)-1$ and girth at least $6$ is odd $6\theta(G)$-colorable, where $\theta(G)$ is the thickness of $G$.


title: Hierarchical Frequency-based Upsampling and Refining for Compressed Video Quality Enhancement

abstract: Video compression artifacts arise due to the quantization operation in the frequency domain. The goal of video quality enhancement is to reduce compression artifacts and reconstruct a visually-pleasant result. In this work, we propose a hierarchical frequency-based upsampling and refining neural network (HFUR) for compressed video quality enhancement. HFUR consists of two modules: implicit frequency upsampling module (ImpFreqUp) and hierarchical and iterative refinement module (HIR). ImpFreqUp exploits DCT-domain prior derived through implicit DCT transform, and accurately reconstructs the DCT-domain loss via a coarse-to-fine transfer. Consequently, HIR is introduced to facilitate cross-collaboration and information compensation between the scales, thus further refine the feature maps and promote the visual quality of the final output. We demonstrate the effectiveness of the proposed modules via ablation experiments and visualized results. Extensive experiments on public benchmarks show that HFUR achieves state-of-the-art performance for both constant bit rate and constant QP modes.


title: Distributed Adaptive Gradient Algorithm with Gradient Tracking for Stochastic Non-Convex Optimization

abstract: This paper considers a distributed stochastic non-convex optimization problem, where the nodes in a network cooperatively minimize a sum of $L$-smooth local cost functions with sparse gradients. By adaptively adjusting the stepsizes according to the historical (possibly sparse) gradients, a distributed adaptive gradient algorithm is proposed, in which a gradient tracking estimator is used to handle the heterogeneity between different local cost functions. We establish an upper bound on the optimality gap, which indicates that our proposed algorithm can reach a first-order stationary solution dependent on the upper bound on the variance of the stochastic gradients. Finally, numerical examples are presented to illustrate the effectiveness of the algorithm.


title: Reinforcement Learning with Token-level Feedback for Controllable Text Generation

abstract: To meet the requirements of real-world applications, it is essential to control generations of large language models (LLMs). Prior research has tried to introduce reinforcement learning (RL) into controllable text generation while most existing methods suffer from overfitting issues (finetuning-based methods) or semantic collapse (post-processing methods). However, current RL methods are generally guided by coarse-grained (sentence/paragraph-level) feedback, which may lead to suboptimal performance owing to semantic twists or progressions within sentences. To tackle that, we propose a novel reinforcement learning algorithm named TOLE which formulates TOken-LEvel rewards for controllable text generation, and employs a "first-quantize-then-noise" paradigm to enhance the robustness of the RL algorithm.Furthermore, TOLE can be flexibly extended to multiple constraints with little computational expense. Experimental results show that our algorithm can achieve superior performance on both single-attribute and multi-attribute control tasks. We have released our codes at https://github.com/WindyLee0822/CTG


title: Pore pressure study in the Irpinia area (Southern Apennines, Italy)

abstract: Subsurface pore pressure studies are crucial for understanding the geomechanical behaviours of the geological formations and for preventing the failure conditions of the rocks. Although the interplay between pore pressure changes and rock deformation is nowadays widely treated in the literature, the magnitude and the distribution of the fluid pressure regimes at depth is not completely clear, especially in those areas, such as the fold and thrust belts, characterised by a complex tectonostratigraphic setting. The proposed study deals with the subsurface fluid dynamics of the Irpinia region, located in the Southern Apennines (Italy) and marked by intense tectonic activity and seismicity. In that area, the most recent and notable Italian earthquake occurred in November 1980 (6.9 Mw) and caused significant damage and loss of life. Irpinia area is also a site of deep gas rising to the surface and exhibits clear correlations between crustal deformation and groundwater circulation. The pressure analysis herein proposed has been performed using direct and indirect pressure measurements collected from 13 hydrocarbon exploration wells available in open source. It provides a detailed description of the methodology used to identify where overpressures develop within the sediments of both autochthonous and allochthonous layers. It also investigates the relationship between pore pressures, gas occurrences found at well sites, and the possible sources of overpressures. The results show that the carbonate successions of the South-Apennines and Apulian Platforms are characterized by predominantly hydrostatic pressure regimes, while the shale-rich successions of the Lagonegrese pelagic basin and the Miocene-Pliocene foredeep basin locally demonstrate moderate overpressured gradients. Finally, the highest overpressures are observed in the evaporitic deposits and Pliocene shales.


title: Variable Hyperparameterized Gaussian Kernel using Displaced Squeezed Vacuum State

abstract: There are schemes for realizing different types of kernels by quantum states of light. It is particularly interesting to realize the Gaussian kernel due to its wider applicability. A multimode coherent state can generate the Gaussian kernel with a constant value of hyperparameter. This constant hyperparameter has limited the application of the Gaussian kernel when it is applied to complex learning problems. We realize the variable hyperparameterized Gaussian kernel with a multimode-displaced squeezed vacuum state. The learning capacity of this kernel is tested with the support vector machines over some synthesized data sets as well as public benchmark data sets. We establish that the proposed variable hyperparameterized Gaussian kernel offers better accuracy over the constant Gaussian kernel.


title: Learning Unified Reference Representation for Unsupervised Multi-class Anomaly Detection

abstract: In the field of multi-class anomaly detection, reconstruction-based methods derived from single-class anomaly detection face the well-known challenge of ``learning shortcuts'', wherein the model fails to learn the patterns of normal samples as it should, opting instead for shortcuts such as identity mapping or artificial noise elimination. Consequently, the model becomes unable to reconstruct genuine anomalies as normal instances, resulting in a failure of anomaly detection. To counter this issue, we present a novel unified feature reconstruction-based anomaly detection framework termed RLR (Reconstruct features from a Learnable Reference representation). Unlike previous methods, RLR utilizes learnable reference representations to compel the model to learn normal feature patterns explicitly, thereby prevents the model from succumbing to the ``learning shortcuts'' issue. Additionally, RLR incorporates locality constraints into the learnable reference to facilitate more effective normal pattern capture and utilizes a masked learnable key attention mechanism to enhance robustness. Evaluation of RLR on the 15-category MVTec-AD dataset and the 12-category VisA dataset shows superior performance compared to state-of-the-art methods under the unified setting. The code of RLR will be publicly available.


title: A Comparison of Joint Species Distribution Models for Percent Cover Data

abstract: 1. Joint species distribution models (JSDMs) have gained considerable traction among ecologists over the past decade, due to their capacity to answer a wide range of questions at both the species- and the community-level. The family of generalized linear latent variable models in particular has proven popular for building JSDMs, being able to handle many response types including presence-absence data, biomass, overdispersed and/or zero-inflated counts. 2. We extend latent variable models to handle percent cover data, with vegetation, sessile invertebrate, and macroalgal cover data representing the prime examples of such data arising in community ecology. 3. Sparsity is a commonly encountered challenge with percent cover data. Responses are typically recorded as percentages covered per plot, though some species may be completely absent or present, i.e., have 0% or 100% cover respectively, rendering the use of beta distribution inadequate. 4. We propose two JSDMs suitable for percent cover data, namely a hurdle beta model and an ordered beta model. We compare the two proposed approaches to a beta distribution for shifted responses, transformed presence-absence data, and an ordinal model for percent cover classes. Results demonstrate the hurdle beta JSDM was generally the most accurate at retrieving the latent variables and predicting ecological percent cover data.


title: Advancing Neuromorphic Computing: Mixed-Signal Design Techniques Leveraging Brain Code Units and Fundamental Code Units

abstract: This paper introduces a groundbreaking digital neuromorphic architecture that innovatively integrates Brain Code Unit (BCU) and Fundamental Code Unit (FCU) using mixedsignal design methodologies. Leveraging open-source datasets and the latest advances in materials science, our research focuses on enhancing the computational efficiency, accuracy, and adaptability of neuromorphic systems. The core of our approach lies in harmonizing the precision and scalability of digital systems with the robustness and energy efficiency of analog processing. Through experimentation, we demonstrate the effectiveness of our system across various metrics. The BCU achieved an accuracy of 88.0% and a power efficiency of 20.0 GOP/s/W, while the FCU recorded an accuracy of 86.5% and a power efficiency of 18.5 GOP/s/W. Our mixed-signal design approach significantly improved latency and throughput, achieving a latency as low as 0.75 ms and throughput up to 213 TOP/s. These results firmly establish the potential of our architecture in neuromorphic computing, providing a solid foundation for future developments in this domain. Our study underscores the feasibility of mixedsignal neuromorphic systems and their promise in advancing the field, particularly in applications requiring high efficiency and adaptability


title: Spatio-temporal point process intensity estimation using zero-deflated subsampling applied to a lightning strikes dataset in France

abstract: Cloud-to-ground lightning strikes observed in a specific geographical domain over time can be naturally modeled by a spatio-temporal point process. Our focus lies in the parametric estimation of its intensity function, incorporating both spatial factors (such as altitude) and spatio-temporal covariates (such as field temperature, precipitation, etc.). The events are observed in France over a span of three years. Spatio-temporal covariates are observed with resolution $0.1^\circ \times 0.1^\circ$ ($\approx 100$km$^2$) and six-hour periods. This results in an extensive dataset, further characterized by a significant excess of zeroes (i.e., spatio-temporal cells with no observed events). We reexamine composite likelihood methods commonly employed for spatial point processes, especially in situations where covariates are piecewise constant. Additionally, we extend these methods to account for zero-deflated subsampling, a strategy involving dependent subsampling, with a focus on selecting more cells in regions where events are observed. A simulation study is conducted to illustrate these novel methodologies, followed by their application to the dataset of lightning strikes.


title: Decentralized Stochastic Subgradient Methods for Nonsmooth Nonconvex Optimization

abstract: In this paper, we concentrate on decentralized optimization problems with nonconvex and nonsmooth objective functions, especially on the decentralized training of nonsmooth neural networks. We introduce a unified framework to analyze the global convergence of decentralized stochastic subgradient-based methods. We prove the global convergence of our proposed framework under mild conditions, by establishing that the generated sequence asymptotically approximates the trajectories of its associated differential inclusion. Furthermore, we establish that our proposed framework covers a wide range of existing efficient decentralized subgradient-based methods, including decentralized stochastic subgradient descent (DSGD), DSGD with gradient-tracking technique (DSGD-T), and DSGD with momentum (DSGD-M). In addition, we introduce the sign map to regularize the update directions in DSGD-M, and show it is enclosed in our proposed framework. Consequently, our convergence results establish, for the first time, global convergence of these methods when applied to nonsmooth nonconvex objectives. Preliminary numerical experiments demonstrate that our proposed framework yields highly efficient decentralized subgradient-based methods with convergence guarantees in the training of nonsmooth neural networks.


title: The effect of Coulomb assisted hopping on STM signal: extended two site Hubbard model analysis

abstract: In this work we study STM signal in the presence of Coulomb assisted hopping. We perform an extended two site Hubbard model analysis between the atom on the tip and the atom in the sample nearest to each other. We show that in the presence of Coulomb assisted hopping the STM signal depends on several spectral functions thereby complicating its interpretation. Furthermore in the broadband tip limit there are now three different competing rates for the total current (instead of one for the usual two site Hubbard model analysis used in the literature so far). We find an exact (within the Fermi golden rule - that is in the limit of weak coupling between tip and sample) expression for the current as a function of the bias voltage. As an example we apply our calculations to the case of free fermions with a uniform density of states. Even in this simple case there are non-trivial corrections - where the $dI/d\mathcal{V}$ (the rate of change of the current with respect to bias voltage) is not uniform as a two site (non-extended) Hubbard model analysis would predict. We also show that for realistic conditions the corrections predicted here are order one.


title: R2SNet: Scalable Domain Adaptation for Object Detection in Cloud-Based Robots Ecosystems via Proposal Refinement

abstract: We introduce a novel approach for scalable domain adaptation in cloud robotics scenarios where robots rely on third-party AI inference services powered by large pre-trained deep neural networks. Our method is based on a downstream proposal-refinement stage running locally on the robots, exploiting a new lightweight DNN architecture, R2SNet. This architecture aims to mitigate performance degradation from domain shifts by adapting the object detection process to the target environment, focusing on relabeling, rescoring, and suppression of bounding-box proposals. Our method allows for local execution on robots, addressing the scalability challenges of domain adaptation without incurring significant computational costs. Real-world results on mobile service robots performing door detection show the effectiveness of the proposed method in achieving scalable domain adaptation.


title: EffiVED:Efficient Video Editing via Text-instruction Diffusion Models

abstract: Large-scale text-to-video models have shown remarkable abilities, but their direct application in video editing remains challenging due to limited available datasets. Current video editing methods commonly require per-video fine-tuning of diffusion models or specific inversion optimization to ensure high-fidelity edits. In this paper, we introduce EffiVED, an efficient diffusion-based model that directly supports instruction-guided video editing. To achieve this, we present two efficient workflows to gather video editing pairs, utilizing augmentation and fundamental vision-language techniques. These workflows transform vast image editing datasets and open-world videos into a high-quality dataset for training EffiVED. Experimental results reveal that EffiVED not only generates high-quality editing videos but also executes rapidly. Finally, we demonstrate that our data collection method significantly improves editing performance and can potentially tackle the scarcity of video editing data. Code can be found at https://github.com/alibaba/EffiVED.


title: Sensitivity Assessment of Multi-Criteria Decision-Making Methods in Chemical Engineering Optimization Applications

abstract: This chapter assesses the sensitivity of multi-criteria decision-making (MCDM) methods to modifications within the decision or objective matrix (DOM) in the context of chemical engineering optimization applications. Employing eight common or recent MCDM methods and three weighting methods, this study evaluates the impact of three specific DOM alterations: linear transformation of an objective (LTO), reciprocal objective reformulation (ROR), and the removal of alternatives (RA). Our comprehensive analysis reveals that the weights generated by entropy method are more sensitive to the examined modifications compared to the criteria importance through intercriteria correlation (CRITIC) and standard deviation (StDev) methods. ROR is found to have the largest effect on the ranking of alternatives. Moreover, certain methods, gray relational analysis (GRA) without any weights, multi-attributive border approximation area comparison (MABAC), combinative distance-based assessment (CODAS), and simple additive weighting (SAW) with entropy or CRITIC weights, and CODAS, SAW, and technique for order of preference by similarity to ideal solution (TOPSIS) with StDev weight are more robust to DOM modifications. This investigation not only corroborates the findings from the previous study, but also offers insights into the stability and reliability of MCDM methods in the context of chemical engineering.


title: LogicalDefender: Discovering, Extracting, and Utilizing Common-Sense Knowledge

abstract: Large text-to-image models have achieved astonishing performance in synthesizing diverse and high-quality images guided by texts. With detail-oriented conditioning control, even finer-grained spatial control can be achieved. However, some generated images still appear unreasonable, even with plentiful object features and a harmonious style. In this paper, we delve into the underlying causes and find that deep-level logical information, serving as common-sense knowledge, plays a significant role in understanding and processing images. Nonetheless, almost all models have neglected the importance of logical relations in images, resulting in poor performance in this aspect. Following this observation, we propose LogicalDefender, which combines images with the logical knowledge already summarized by humans in text. This encourages models to learn logical knowledge faster and better, and concurrently, extracts the widely applicable logical knowledge from both images and human knowledge. Experiments show that our model has achieved better logical performance, and the extracted logical knowledge can be effectively applied to other scenarios.


title: Logistic regression to boost exoplanet detection performances

abstract: Direct imaging of exoplanets requires to separate the background noise from the exoplanet signals. Statistical methods have been recently proposed to avoid subtracting any signal of interest as opposed to initial self-subtracting methods based on Angular Differential Imaging (ADI). However, unless conservative thresholds are chosen to claim for a detection, such approaches tend to produce a list of candidates that include many false positives. Choosing high, conservative, thresholds leads to miss the faintest planets. We extend a statistical framework with a logistic regression to filter the list of candidates. Features with physical/optical meaning (in two wavelengths) are used, leading to a very fast and pragmatic approach. The overall method requires a simple edge detection (image processing) and clustering algorithm to work with sub-images. To estimate its efficiency, we apply our approach to targets observed with the ESO/SPHERE high contrast imager, that were previously used as tests for blind surveys. Experimental results with injected signals show that either the number of false detections is considerably reduced or faint exoplanets that would otherwise not be detected can be sometimes found. Typically, on the blind tests performed, we are now able to detect around 50% more of the injected planets with an SNR below 5, and with a very low number of additional candidates.


title: Augment Before Copy-Paste: Data and Memory Efficiency-Oriented Instance Segmentation Framework for Sport-scenes

abstract: Instance segmentation is a fundamental task in computer vision with broad applications across various industries. In recent years, with the proliferation of deep learning and artificial intelligence applications, how to train effective models with limited data has become a pressing issue for both academia and industry. In the Visual Inductive Priors challenge (VIPriors2023), participants must train a model capable of precisely locating individuals on a basketball court, all while working with limited data and without the use of transfer learning or pre-trained models. We propose Memory effIciency inStance Segmentation framework based on visual inductive prior flow propagation that effectively incorporates inherent prior information from the dataset into both the data preprocessing and data augmentation stages, as well as the inference phase. Our team (ACVLAB) experiments demonstrate that our model achieves promising performance (0.509 AP@0.50:0.95) even under limited data and memory constraints.


title: Just Add $100 More: Augmenting NeRF-based Pseudo-LiDAR Point Cloud for Resolving Class-imbalance Problem

abstract: Typical LiDAR-based 3D object detection models are trained in a supervised manner with real-world data collection, which is often imbalanced over classes (or long-tailed). To deal with it, augmenting minority-class examples by sampling ground truth (GT) LiDAR points from a database and pasting them into a scene of interest is often used, but challenges still remain: inflexibility in locating GT samples and limited sample diversity. In this work, we propose to leverage pseudo-LiDAR point clouds generated (at a low cost) from videos capturing a surround view of miniatures or real-world objects of minor classes. Our method, called Pseudo Ground Truth Augmentation (PGT-Aug), consists of three main steps: (i) volumetric 3D instance reconstruction using a 2D-to-3D view synthesis model, (ii) object-level domain alignment with LiDAR intensity estimation and (iii) a hybrid context-aware placement method from ground and map information. We demonstrate the superiority and generality of our method through performance improvements in extensive experiments conducted on three popular benchmarks, i.e., nuScenes, KITTI, and Lyft, especially for the datasets with large domain gaps captured by different LiDAR configurations. Our code and data will be publicly available upon publication.


title: Offline Multitask Representation Learning for Reinforcement Learning

abstract: We study offline multitask representation learning in reinforcement learning (RL), where a learner is provided with an offline dataset from different tasks that share a common representation and is asked to learn the shared representation. We theoretically investigate offline multitask low-rank RL, and propose a new algorithm called MORL for offline multitask representation learning. Furthermore, we examine downstream RL in reward-free, offline and online scenarios, where a new task is introduced to the agent that shares the same representation as the upstream offline tasks. Our theoretical results demonstrate the benefits of using the learned representation from the upstream offline task instead of directly learning the representation of the low-rank model.


title: Task-Oriented Hybrid Beamforming for OFDM-DFRC Systems with Flexibly Controlled Space-Frequency Spectra

abstract: This paper investigates the issues of the hybrid beamforming design for the orthogonal frequency division multiplexing dual-function radar-communication (DFRC) system in multiple task scenarios involving the radar scanning and detection task and the target tracking task. To meet different task requirements of the DFRC system, we introduce two novel radar beampattern metrics, the average integrated sidelobe to minimum mainlobe ratio (AISMMR) and average peak sidelobe to integrated mainlobe ratio (APSIMR), to characterize the space-frequency spectra in different scenarios. Then, two HBF design problems are formulated for two task scenarios by minimizing the AISMMR and APSIMR respectively subject to the constraints of communication quality-of-service (QoS), power budget, and hardware. Due to the non-linearity and close coupling between the analog and digital beamformers in both the objective functions and QoS constraint, the resultant formulated problems are challenging to solve. Towards that end, a unified optimization algorithm based on a consensus alternating direction method of multipliers (CADMM) is proposed to solve these two problems. Moreover, under the unified CADMM framework, the closed-form solutions of primal variables in the original two problems are obtained with low complexity. Numerical simulations are provided to demonstrate the feasibility and effectiveness of the proposed algorithm.


title: MISS: Memory-efficient Instance Segmentation Framework By Visual Inductive Priors Flow Propagation

abstract: Instance segmentation, a cornerstone task in computer vision, has wide-ranging applications in diverse industries. The advent of deep learning and artificial intelligence has underscored the criticality of training effective models, particularly in data-scarce scenarios - a concern that resonates in both academic and industrial circles. A significant impediment in this domain is the resource-intensive nature of procuring high-quality, annotated data for instance segmentation, a hurdle that amplifies the challenge of developing robust models under resource constraints. In this context, the strategic integration of a visual prior into the training dataset emerges as a potential solution to enhance congruity with the testing data distribution, consequently reducing the dependency on computational resources and the need for highly complex models. However, effectively embedding a visual prior into the learning process remains a complex endeavor. Addressing this challenge, we introduce the MISS (Memory-efficient Instance Segmentation System) framework. MISS leverages visual inductive prior flow propagation, integrating intrinsic prior knowledge from the Synergy-basketball dataset at various stages: data preprocessing, augmentation, training, and inference. Our empirical evaluations underscore the efficacy of MISS, demonstrating commendable performance in scenarios characterized by limited data availability and memory constraints.


title: 3DGS-Calib: 3D Gaussian Splatting for Multimodal SpatioTemporal Calibration

abstract: Reliable multimodal sensor fusion algorithms require accurate spatiotemporal calibration. Recently, targetless calibration techniques based on implicit neural representations have proven to provide precise and robust results. Nevertheless, such methods are inherently slow to train given the high computational overhead caused by the large number of sampled points required for volume rendering. With the recent introduction of 3D Gaussian Splatting as a faster alternative to implicit representation methods, we propose to leverage this new rendering approach to achieve faster multi-sensor calibration. We introduce 3DGS-Calib, a new calibration method that relies on the speed and rendering accuracy of 3D Gaussian Splatting to achieve multimodal spatiotemporal calibration that is accurate, robust, and with a substantial speed-up compared to methods relying on implicit neural representations. We demonstrate the superiority of our proposal with experimental results on sequences from KITTI-360, a widely used driving dataset.


title: AdaMER-CTC: Connectionist Temporal Classification with Adaptive Maximum Entropy Regularization for Automatic Speech Recognition

abstract: In Automatic Speech Recognition (ASR) systems, a recurring obstacle is the generation of narrowly focused output distributions. This phenomenon emerges as a side effect of Connectionist Temporal Classification (CTC), a robust sequence learning tool that utilizes dynamic programming for sequence mapping. While earlier efforts have tried to combine the CTC loss with an entropy maximization regularization term to mitigate this issue, they employed a constant weighting term on the regularization during the training, which we find may not be optimal. In this work, we introduce Adaptive Maximum Entropy Regularization (AdaMER), a technique that can modulate the impact of entropy regularization throughout the training process. This approach not only refines ASR model training but ensures that as training proceeds, predictions display the desired model confidence.


title: Fractional Dimensional Approach to Dielectric Tuning Effects on Excitonic Parameters in 2D semiconductor materials

abstract: We demonstrated the potential of the fractional dimensional approach to understand exciton parameters in the exemplary atomically thin semiconductor material, a monolayer of WS$_2$. This approach has proved to be successful in finding the exciton binding energy and quasiparticle bandgap for the WS$_2$ monolayer in varying dielectric environments. A tuning of the quasiparticle bandgap and binding energy by 141 meV and 188 meV, respectively, has been achieved by varying the dielectric of the environment from 1.52 to 8.1. The approach is justified by comparing the changes in the binding energy with the computational results from the Quantum Electrostatic Heterostructures model. The fractional dimension found through the excitonic Rydberg series is close to 2.8 for WS$_2$ monolayer in all different dielectric surroundings. Thus, this approach provides a rapid and robust method for determining the binding energy of excitons in 2D semiconductors independent of the particular dielectric environment.


title: Investigation of magnetic order influenced phonon and electron dynamics in MnBi$_{2}$Te$_{4}$ and Sb doped MnBi$_{2}$Te$_{4}$ through terahertz time-domain spectroscopy

abstract: MnBi$_{2}$Te$_{4}$, the first topological insulator with inherent magnetic ordering, has attracted significant attention recently for providing a platform to realize several exotic quantum phenomena at relatively higher temperatures. In this work, we have carried out an exhaustive investigation of MnBi$_{2}$Te$_{4}$ and Sb doped MnBi$_{2}$Te$_{4}$ thin films using THz time-domain spectroscopy. The extracted real THz conductivity displays a strong IR active E$_u$ phonon absorption peak (at $\sim$1.5 THz) merged on top of the Drude-like contributions from bulk and surface electrons. The extracted parameters from the THz conductivity data fitted to the Drude-Fano-Lorentz model, show significant changes in their temperature dependence around the magnetic ordering N\'eel temperature of $\sim$ 25K, which is suggestive of the coupling between magnetic ordering and electronic band structure. The frequency of the E$_u$ phonon displays an anomalous blue-shift with increasing temperatures by $\sim$ 0.1 THz ($\sim$7 %) for MnBi$_{2}$Te$_{4}$ and $\sim$0.2 THz ($\sim$13 %) for Sb doped MnBi$_{2}$Te$_{4}$ between 7K and 250K. The line-shape of the E$_u$ phonon mode in Sb doped MnBi$_{2}$Te$_{4}$ shows significant Fano asymmetry compared to that of MnBi$_{2}$Te$_{4}$, indicating that Sb doping plays an important role in the Fano interference between the phonons and the electrons, in this system. These results indicate that the anomalous phonon behaviour seen in MBT arise mainly from positive cubic anharmonicity induced self energy parameter, whereas both anharmonicity and the electron phonon coupling are at play in making the relatively higher anomalous blue shift of phonons in MBST. Our studies provide the first comprehensive understanding of the phonon and electron dynamics of MnBi$_{2}$Te$_{4}$ and Sb doped MnBi$_{2}$Te$_{4}$ in the THz range using time-domain THz spectroscopy.


title: Giant CP violation in charmless three-body $B$ meson decays at LHCb: all order formalism for meson-meson final state interactions

abstract: LHCb has observed giant CP violation in localized regions of the Dalitz plots of B to three charmless light mesons. This has been interpreted as an enhancement due to strong two-body final state interactions. In this talk, we show how such interactions, described with dispersive analyses of data, can be implemented beyond the leading order expansion in the two-body re-scattering amplitude.


title: OurDB: Ouroboric Domain Bridging for Multi-Target Domain Adaptive Semantic Segmentation

abstract: Multi-target domain adaptation (MTDA) for semantic segmentation poses a significant challenge, as it involves multiple target domains with varying distributions. The goal of MTDA is to minimize the domain discrepancies among a single source and multi-target domains, aiming to train a single model that excels across all target domains. Previous MTDA approaches typically employ multiple teacher architectures, where each teacher specializes in one target domain to simplify the task. However, these architectures hinder the student model from fully assimilating comprehensive knowledge from all target-specific teachers and escalate training costs with increasing target domains. In this paper, we propose an ouroboric domain bridging (OurDB) framework, offering an efficient solution to the MTDA problem using a single teacher architecture. This framework dynamically cycles through multiple target domains, aligning each domain individually to restrain the biased alignment problem, and utilizes Fisher information to minimize the forgetting of knowledge from previous target domains. We also propose a context-guided class-wise mixup (CGMix) that leverages contextual information tailored to diverse target contexts in MTDA. Experimental evaluations conducted on four urban driving datasets (i.e., GTA5, Cityscapes, IDD, and Mapillary) demonstrate the superiority of our method over existing state-of-the-art approaches.


title: Exploring active learning in physics with ISLE-based modules in high school

abstract: This study presents a case study of active learning within the Investigative Science Learning Environment (ISLE), using the iOLab digital devices. We designed a pilot lab format to enhance student engagement and understanding through direct experimentation, taking advantage of the multifunctional capabilities of the iOLab devices. This paper evaluates the pedagogical effectiveness of integrating ISLE with digital tools for data collection and analysis in physics experiments. The initial findings provide insights into the pedagogical benefits and logistical considerations of using such technologies in a laboratory setting. Although no direct comparison with traditional teaching methods has been made, the observed student engagement and feedback suggest a positive impact on learning outcomes, even within the constraints of the short duration of the interventions.


title: Long time behaviour of solutions to non-local and non-linear dispersion problems

abstract: This paper explores a non-linear, non-local model describing the evolution of a single species. We investigate scenarios where the spatial domain is either an arbitrary bounded and open subset of the $n$-dimensional Euclidean space or a periodic environment modeled by $n$-dimensional torus. The analysis includes the study of spectrum of the linear, bounded operator in the considered equation, which is a scaled, non-local analogue of classical Laplacian with Neumann boundaries. In particular we show the explicit formulas for eigenvalues and eigenfunctions. Moreover we show the asymptotic behaviour of eigenvalues. Within the context of the non-linear evolution problem, we establish the existence of an invariant region, give a criterion for convergence to the mean mass, and construct spatially heterogeneous steady states.


title: Linguacodus: A Synergistic Framework for Transformative Code Generation in Machine Learning Pipelines

abstract: In the ever-evolving landscape of machine learning, seamless translation of natural language descriptions into executable code remains a formidable challenge. This paper introduces Linguacodus, an innovative framework designed to tackle this challenge by deploying a dynamic pipeline that iteratively transforms natural language task descriptions into code through high-level data-shaping instructions. The core of Linguacodus is a fine-tuned large language model (LLM), empowered to evaluate diverse solutions for various problems and select the most fitting one for a given task. This paper details the fine-tuning process, and sheds light on how natural language descriptions can be translated into functional code. Linguacodus represents a substantial leap towards automated code generation, effectively bridging the gap between task descriptions and executable code. It holds great promise for advancing machine learning applications across diverse domains. Additionally, we propose an algorithm capable of transforming a natural description of an ML task into code with minimal human interaction. In extensive experiments on a vast machine learning code dataset originating from Kaggle, we showcase the effectiveness of Linguacodus. The investigations highlight its potential applications across diverse domains, emphasizing its impact on applied machine learning in various scientific fields.


title: DynoSurf: Neural Deformation-based Temporally Consistent Dynamic Surface Reconstruction

abstract: This paper explores the problem of reconstructing temporally consistent surfaces from a 3D point cloud sequence without correspondence. To address this challenging task, we propose DynoSurf, an unsupervised learning framework integrating a template surface representation with a learnable deformation field. Specifically, we design a coarse-to-fine strategy for learning the template surface based on the deformable tetrahedron representation. Furthermore, we propose a learnable deformation representation based on the learnable control points and blending weights, which can deform the template surface non-rigidly while maintaining the consistency of the local shape. Experimental results demonstrate the significant superiority of DynoSurf over current state-of-the-art approaches, showcasing its potential as a powerful tool for dynamic mesh reconstruction. The code is publicly available at https://github.com/yaoyx689/DynoSurf.


abstract: In this work we study One Axis Twisting (OAT) spin squeezing for metrology in the presence of decoherence. We study Linbladian evolution in the presence of both T_1 and T_2 (longitudinal and transverse relaxation processes). We show that spin squeezing can be an effective way to improve metrological accuracy even in the presence of decoherence for OAT squeezing. We show our results are not sensitive to inhomogeneity of the squeezing strength of the many spin OAT Hamiltonian and that very general squeezed states do not have entanglement enhanced decoherence. We also extend the Kitagawa-Ueda OAT squeezing formula to finite polarization.


title: Numerical observation of $\mathrm{SU}(N)$ Nagaoka ferromagnetism

abstract: We provide numerical evidence of the Nagaoka's theorem in the $\mathrm{SU}(N)$ Fermi-Hubbard model on various cluster geometries, such as the square, the honeycomb and the triangular lattices. In particular, by diagonalizing several finite-size clusters, we show that for one hole away from filling $1/N$, the itinerant ferromagnetism arises for $U$ (the positive on-site interaction) larger than $U_c$ (the value at the transition), which strongly depends on the coordination number $z$ and on $N$, the number of degenerate orbitals, that we vary from $N=2$ to $N=6$ in our simulations. We prove that $U_c$ is a non decreasing function of $N$. In addition, we find that the lattice dependency is rooted in the kinetic energy of the hole. We find that large coordination numbers $z$ lower the value of $U_c$. Complementary, we explore the effect of long-range hopping on the appearance of itinerant ferromagnetism and demonstrate that it acts as an increased coordination number, protecting the ferromagnetic phase at small $U$. Finally, both the effects of the presence of some additional holes and of the finite size of the clusters are briefly discussed.


title: UV Gaussians: Joint Learning of Mesh Deformation and Gaussian Textures for Human Avatar Modeling

abstract: Reconstructing photo-realistic drivable human avatars from multi-view image sequences has been a popular and challenging topic in the field of computer vision and graphics. While existing NeRF-based methods can achieve high-quality novel view rendering of human models, both training and inference processes are time-consuming. Recent approaches have utilized 3D Gaussians to represent the human body, enabling faster training and rendering. However, they undermine the importance of the mesh guidance and directly predict Gaussians in 3D space with coarse mesh guidance. This hinders the learning procedure of the Gaussians and tends to produce blurry textures. Therefore, we propose UV Gaussians, which models the 3D human body by jointly learning mesh deformations and 2D UV-space Gaussian textures. We utilize the embedding of UV map to learn Gaussian textures in 2D space, leveraging the capabilities of powerful 2D networks to extract features. Additionally, through an independent Mesh network, we optimize pose-dependent geometric deformations, thereby guiding Gaussian rendering and significantly enhancing rendering quality. We collect and process a new dataset of human motion, which includes multi-view images, scanned models, parametric model registration, and corresponding texture maps. Experimental results demonstrate that our method achieves state-of-the-art synthesis of novel view and novel pose. The code and data will be made available on the homepage https://alex-jyj.github.io/UV-Gaussians/ once the paper is accepted.


title: HSEmotion Team at the 6th ABAW Competition: Facial Expressions, Valence-Arousal and Emotion Intensity Prediction

abstract: This article presents our results for the sixth Affective Behavior Analysis in-the-wild (ABAW) competition. To improve the trustworthiness of facial analysis, we study the possibility of using pre-trained deep models that extract reliable emotional features without the need to fine-tune the neural networks for a downstream task. In particular, we introduce several lightweight models based on MobileViT, MobileFaceNet, EfficientNet, and DDAMFN architectures trained in multi-task scenarios to recognize facial expressions, valence, and arousal on static photos. These neural networks extract frame-level features fed into a simple classifier, e.g., linear feed-forward neural network, to predict emotion intensity, compound expressions, action units, facial expressions, and valence/arousal. Experimental results for five tasks from the sixth ABAW challenge demonstrate that our approach lets us significantly improve quality metrics on validation sets compared to existing non-ensemble techniques.


title: A physics-informed neural network method for the approximation of slow invariant manifolds for the general class of stiff systems of ODEs

abstract: We present a physics-informed neural network (PINN) approach for the discovery of slow invariant manifolds (SIMs), for the most general class of fast/slow dynamical systems of ODEs. In contrast to other machine learning (ML) approaches that construct reduced order black box surrogate models using simple regression, and/or require a priori knowledge of the fast and slow variables, our approach, simultaneously decomposes the vector field into fast and slow components and provides a functional of the underlying SIM in a closed form. The decomposition is achieved by finding a transformation of the state variables to the fast and slow ones, which enables the derivation of an explicit, in terms of fast variables, SIM functional. The latter is obtained by solving a PDE corresponding to the invariance equation within the Geometric Singular Perturbation Theory (GSPT) using a single-layer feedforward neural network with symbolic differentiation. The performance of the proposed physics-informed ML framework is assessed via three benchmark problems: the Michaelis-Menten, the target mediated drug disposition (TMDD) reaction model and a fully competitive substrate-inhibitor(fCSI) mechanism. We also provide a comparison with other GPST methods, namely the quasi steady state approximation (QSSA), the partial equilibrium approximation (PEA) and CSP with one and two iterations. We show that the proposed PINN scheme provides SIM approximations, of equivalent or even higher accuracy, than those provided by QSSA, PEA and CSP, especially close to the boundaries of the underlying SIMs.


title: Surface hopping molecular dynamics simulation of ultrafast methyl iodide photodissociation mapped by Coulomb explosion imaging

abstract: We present a highly efficient method to directly simulate the photodissociation followed by Coulomb explosion of methyl iodide. In order to achieve statistical reliability, more than 40,000 trajectories are calculated on accurate potential energy surfaces of both the neutral molecule and the doubly charged cation. Non-adiabatic effects during photodissociation are treated using a Landau-Zener surface hopping algorithm. The simulation is performed analogous to a recent pump-probe experiment using coincident ion momentum imaging [Ziaee \textit{et al., Phys. Chem. Chem. Phys.} 2023, \textbf{25}, 9999]. At large pump-probe delays, the simulated delay-dependent kinetic energy release signals show overall good agreement with the experiment, with two major dissociation channels leading to $\text{I}(^2\text{P}_{3/2})$ and $\text{I}^*(^2\text{P}_{1/2})$ products. At short pump-probe delays, the simulated kinetic energy release shows a clear bifurcation near 12 fs, owing to non-adiabatic transitions through a conical intersection. The developed method is particularly suitable and efficient in simulating processes that highly rely on statistics or for identifying rare reaction channels.


title: End-to-end multi-modal product matching in fashion e-commerce

abstract: Product matching, the task of identifying different representations of the same product for better discoverability, curation, and pricing, is a key capability for online marketplace and e-commerce companies. We present a robust multi-modal product matching system in an industry setting, where large datasets, data distribution shifts and unseen domains pose challenges. We compare different approaches and conclude that a relatively straightforward projection of pretrained image and text encoders, trained through contrastive learning, yields state-of-the-art results, while balancing cost and performance. Our solution outperforms single modality matching systems and large pretrained models, such as CLIP. Furthermore we show how a human-in-the-loop process can be combined with model-based predictions to achieve near perfect precision in a production system.


title: Mitigation of the Microbunching Instability Through Transverse Landau Damping

abstract: The microbunching instability has been a long-standing issue for high-brightness free-electron lasers (FELs), and is a significant show-stopper to achieving full longitudinal coherence in the x-ray regime. This paper reports the first experimental demonstration of microbunching instability mitigation through transverse Landau damping, based on linear optics control in a dispersive region. Analytical predictions for the microbunching content are supported by numerical calculations of the instability gain and confirmed through the experimental characterization of the spectral brightness of the FERMI FEL under different transverse optics configurations of the transfer line between the linear accelerator and the FEL.


title: Semi-Analytical Methods for Population Balance models involving Aggregation and Breakage processes: A comparative study

abstract: Population balance models often integrate fundamental kernels, including sum, gelling and Brownian aggregation kernels. These kernels have demonstrated extensive utility across various disciplines such as aerosol physics, chemical engineering, astrophysics, pharmaceutical sciences and mathematical biology for the purpose of elucidating particle dynamics. The objective of this study is to refine the semi-analytical solutions derived from current methodologies in addressing the nonlinear aggregation and coupled aggregation-breakage population balance equation. This work presents a unique semi-analytical approach based on the homotopy analysis method (HAM) to solve pure aggregation and couple aggregation-fragmentation population balance equations, which is an integro-partial differentia equation. By decomposing the non-linear operator, we investigate how to utilize the convergence control parameter to expedite the convergence of the HAM solution towards its precise values in the proposed method.


title: A singular perturbation result for infinite-dimensional coupled systems

abstract: This paper deals with an infinite dimensional version of the singular perturbation method. It is, more precisely, an exponential stability result for a system composed by a fast and a slow dynamics that may involve infinite-dimensional dynamics where, roughly speaking, the system can be approximated into two decoupled systems for which the stability conditions are easier to check. The classical singular perturbation result states that, as soon as the fast system is sufficiently fast, then the exponential stability conditions for the full-system can be reduced to the exponential stability conditions for the two decoupled systems. In this article, it is proved that the classical singular perturbation method can be applied when facing with a slow infinite-dimensional system coupled with a fast finite-dimensional system. The proof relies on a Lyapunov approach, more precisely with the construction a functional inspired by the forwarding method. The well-posedness proof is obtained thanks to the regular system theory. In addition to these result, a Tikhnov theorem is proved. Namely, supposing that the initial condition depends on $\varepsilon$, the parameter modeling the difference between the two time-scales, the trajectory of the full-system is proved to depend linearly on $\varepsilon$.


title: Rare Charm Decays at BESIII

abstract: The rare and forbidden processes within the Standard Model offer an opportunity to explore potential new physics beyond the SM. We summarize the research method and the recent results of rare charm decays at BESIII based on the extensive data samples in the $\tau-c$ energy region, many of which impose stringent constraints on the new physics.


title: Optimal Layout Synthesis for Deep Quantum Circuits on NISQ Processors with 100+ Qubits

abstract: Layout synthesis is mapping a quantum circuit to a quantum processor. SWAP gate insertions are needed for scheduling 2-qubit gates only on connected physical qubits. With the ever-increasing number of qubits in NISQ processors, scalable layout synthesis is of utmost importance. With large optimality gaps observed in heuristic approaches, scalable exact methods are needed. While recent exact and near-optimal approaches scale to moderate circuits, large deep circuits are still out of scope. In this work, we propose a SAT encoding based on parallel plans that apply 1 SWAP and a group of CNOTs at each time step. Using domain-specific information, we maintain optimality in parallel plans while scaling to large and deep circuits. From our results, we show the scalability of our approach which significantly outperforms leading exact and near-optimal approaches (up to 100x). For the first time, we can optimally map several 8, 14, and 16 qubit circuits onto 54, 80, and 127 qubit platforms with up to 17 SWAPs. While adding optimal SWAPs, we also report near-optimal depth in our mapped circuits.


title: Inverse Coefficient Problem for One-Dimensional Subdiffusion with Data on Disjoint Sets in Time

abstract: In this work we investigate an inverse coefficient problem for the one-dimensional subdiffusion model, which involves a Caputo fractional derivative in time. The inverse problem is to determine two coefficients and multiple parameters (the order, and length of the interval) from one pair of lateral Cauchy data. The lateral Cauchy data are given on disjoint sets in time with a single excitation and the measurement is made on a time sequence located outside the support of the excitation. We prove two uniqueness results for different lateral Cauchy data. The analysis is based on the solution representation, analyticity of the observation and a refined version of inverse Sturm-Liouville theory due to Sini [35]. Our results heavily exploit the memory effect of fractional diffusion for the unique recovery of the coefficients in the model. Several numerical experiments are also presented to complement the analysis.


title: Finite element method coupled with multiscale finite element method for the non-stationary Stokes-Darcy model

abstract: In this paper, we combine the multiscale flnite element method to propose an algorithm for solving the non-stationary Stokes-Darcy model, where the permeability coefflcient in the Darcy region exhibits multiscale characteristics. Our algorithm involves two steps: first, conducting the parallel computation of multiscale basis functions in the Darcy region. Second, based on these multiscale basis functions, we employ an implicitexplicit scheme to solve the Stokes-Darcy equations. One signiflcant feature of the algorithm is that it solves problems on relatively coarse grids, thus signiflcantly reducing computational costs. Moreover, under the same coarse grid size, it exhibits higher accuracy compared to standard flnite element method. Under the assumption that the permeability coefflcient is periodic and independent of time, this paper demonstrates the stability and convergence of the algorithm. Finally, the rationality and effectiveness of the algorithm are verifled through three numerical experiments, with experimental results consistent with theoretical analysis.


title: Layer potential operators for transmission problems on extension domains

abstract: We use the well-posedness of transmission problems on classes of two-sided Sobolev extension domains to give variational definitions for (boundary) layer potential operators and Neumann-Poincar{\'e} operators. These classes of domains contain Lipschitz domains, and also domains with fractal boundaries. Although our variational formulation does not involve any measures on the boundary, we recover the classical results in smooth domains by considering the surface measure on the boundary. We discuss properties of these operators and generalize basic results in imaging beyond the Lipschitz case.


title: Collapsing regular Riemannian foliations with flat leaves

abstract: We present how to collapse a manifold equipped with a closed flat regular Riemannian foliation with leaves of positive dimension on a compact manifold, while keeping the sectional curvature uniformly bounded from above and below. From this deformation, we show that a closed flat regular Riemannian foliation with leaves of positive dimension on a compact simply-connected manifold is given by torus actions. This gives a geometric characterization of aspherical regular Riemannian foliations given by torus actions.


title: Fair Distributed Cooperative Bandit Learning on Networks for Intelligent Internet of Things Systems (Technical Report)

abstract: In intelligent Internet of Things (IoT) systems, edge servers within a network exchange information with their neighbors and collect data from sensors to complete delivered tasks. In this paper, we propose a multiplayer multi-armed bandit model for intelligent IoT systems to facilitate data collection and incorporate fairness considerations. In our model, we establish an effective communication protocol that helps servers cooperate with their neighbors. Then we design a distributed cooperative bandit algorithm, DC-ULCB, enabling servers to collaboratively select sensors to maximize data rates while maintaining fairness in their choices. We conduct an analysis of the reward regret and fairness regret of DC-ULCB, and prove that both regrets have logarithmic instance-dependent upper bounds. Additionally, through extensive simulations, we validate that DC-ULCB outperforms existing algorithms in maximizing reward and ensuring fairness.


title: FLRW Cosmology in Myrzakulov $F(R,Q)$ Gravity

abstract: In the present work, we investigate some exact cosmological models in the Myrzakulov $F(R,Q)$ gravity or the Myrzakulov gravity-II (MG-II) which was proposed in [arXiv:1205.5266]. Here $R$ and $Q$ are the curvature and nonmetricity scalars using non-special connection, respectively. We have solved field equations in two different contexts using a flat FLRW metric. We have obtained two exact solutions in the form of scale factor $a(t)$, and using this scale factor, we have derived other cosmological parameters. After that using recent observational datasets $H(z)$ and Pantheon SNe Ia, we have obtained best fit constrained values of model parameters by applying the MCMC analysis. Using these best fit values of model parameters, we have discussed the results behaviour of the derived models. We have found that both models are transit phase model and approaches to $\Lambda$CDM model at late-time universe. We have found that the geometrical sector dark equation of state $\omega_{(geom)}$ behaves just like dark energy candidate. Also, we have estimated the transition redshift $z_{t}$ and present age of the universe $t_{0}$ which are consistent with recent observations.


title: Criterion of Internal Stability of Linear Formations

abstract: Necessary and sufficient conditions for the internal stability of formations whose dynamics are obtained is determined by linear differential equations.


title: Laser Annealed SiO2/Si1-xGex Scaffolds for Nanoscaled Devices, Synergy of Experiment and Computation

abstract: Ultraviolet nanosecond laser annealing (UV-NLA) proves to be an important technique, particularly when tightly controlled heating and melting are necessary. In the realm of semiconductor technologies, the significance of nanosecond laser annealing (NLA) grows in tandem with the escalating intricacy of integration schemes in nano-scaled devices. Silicon-germanium alloys have been studied for decades for their compatibility with silicon devices. Indeed, they enable the manipulation of properties like strain, carrier mobilities and bandgap. In this framework, they can for instance boost the performances of p-type MOSFETs but also enable near infra-red absorption and emission for applications in photo-detection and photonics. Laser melting on such type of layers, however results, up to now, in the development of extended defects and poor control over layer morphology and homogeneity. In our study, we investigate the laser melting of ~700 nm thick relaxed silicon-germanium samples coated with SiO2 nano-arrays, observing the resulting material to maintain an unaltered lattice. We found the geometrical parameters of the silicon oxide having an impact on the thermal budget samples see, influencing melt threshold, melt depth and germanium distribution.


title: AGRNav: Efficient and Energy-Saving Autonomous Navigation for Air-Ground Robots in Occlusion-Prone Environments

abstract: The exceptional mobility and long endurance of air-ground robots are raising interest in their usage to navigate complex environments (e.g., forests and large buildings). However, such environments often contain occluded and unknown regions, and without accurate prediction of unobserved obstacles, the movement of the air-ground robot often suffers a suboptimal trajectory under existing mapping-based and learning-based navigation methods. In this work, we present AGRNav, a novel framework designed to search for safe and energy-saving air-ground hybrid paths. AGRNav contains a lightweight semantic scene completion network (SCONet) with self-attention to enable accurate obstacle predictions by capturing contextual information and occlusion area features. The framework subsequently employs a query-based method for low-latency updates of prediction results to the grid map. Finally, based on the updated map, the hierarchical path planner efficiently searches for energy-saving paths for navigation. We validate AGRNav's performance through benchmarks in both simulated and real-world environments, demonstrating its superiority over classical and state-of-the-art methods. The open-source code is available at https://github.com/jmwang0117/AGRNav.


title: Truncated theta series from the Bailey lattice

abstract: In 2012, Andrews and Merca obtained a truncated version of Euler's pentagonal number theorem and showed the nonnegativity related to partition functions. Meanwhile, Andrews-Merca and Guo-Zeng independently conjectured that the truncated Jacobi triple product series has nonnegative coefficients, which has been confirmed analytically and also combinatorially. In 2022, Merca proposed a stronger version for this conjecture. In this paper, by applying Agarwal, Andrews and Bressoud's Bailey lattice, we derive a truncated version for the Jacobi triple product series with odd basis which reduces to the Andrews-Gordon identity as a special instance. As consequences, we obtain new truncated forms for Euler's pentagonal number theorem, Gauss'theta series on triangular numbers and square numbers, which lead to inequalities for certain partition functions. Moreover, by considering a truncated theta series involving $\ell$-regular partitions, we confirm a conjecture proposed by Ballantine and Merca about 6-regular partitions and show that Merca's stronger conjecture on truncated Jacobi triple product series holds when $R = 3S$ for $S \geq 1.$


title: Orthosymplectic diagonalization in Williamson's theorem

abstract: In this paper, we provide an algebraic condition on any $2n \times 2n$ real symmetric positive definite matrix which is necessary and sufficient for the matrix to be diagonalized by an orthosymplectic matrix in the sense of Williamson's theorem.

categories: math.FA math-ph math.MP math.SP quant-ph


title: On the weak and strong field effects in antiscalar background

abstract: The triumph of general relativity under the banner "gravity is geometry" began with confirming the crucial effects within the Solar system and proceeded recently to the strong-field shadow effect for the compact object in the center of the Milky Way. Here, we examine some of those phenomena for the Einstein-scalar equations in the antiscalar regime to reveal the difference from vacuum both in weak and strong fields. As a result, we find that for week-field perihelion shift the difference between vacuum and antiscalar cases proves to be observationally imperceptible in practice, even for S-cluster stars with high eccentricities, and even if accumulated over a century. In strong-field case, we reconsider the shadow effect (this time without involving complex-valued scalar field) as the most perspective from an observational viewpoint. Even though the resulting difference is quite appreciable (about 5%), no conclusion can be made until the mass of the central object is known with the accuracy an order of magnitude higher than the currently available.


title: A splitting-based KPIK method for eddy current optimal control problems in an all-at-once approach

abstract: In this paper, we focus on efficient methods to solve discretized linear systems obtained from eddy current optimal control problems in an all-at-once approach. We construct a new low-rank matrix equation method based on a special splitting of the coefficient matrix and the Krylov-plus-inverted-Krylov (KPIK) algorithm. Firstly, we rewrite the resulting discretized linear system in a matrix-equation form. Then using the KPIK algorithm, we can obtain the low-rank approximation solution. The new method is named the splitting-based Krylov-plus-inverted-Krylov (SKPIK) method. The SKPIK method can not only solve the large and sparse discretized systems fast but also overcomes the storage problem. Theoretical results about the existence of the low-rank solutions are given. Numerical experiments are used to illustrate the performance of the new low-rank matrix equation method by compared with some existing classical efficient methods.


title: Shadow Hamiltonians of structure-preserving integrators for Nambu mechanics

abstract: Symplectic integrators are widely implemented numerical integrators for Hamiltonian mechanics, which preserve the Hamiltonian structure (symplecticity) of the system. Although the symplectic integrator does not conserve the energy of the system, it is well known that there exists a conserving modified Hamiltonian, called the shadow Hamiltonian. For the Nambu mechanics, which is a kind of generalized Hamiltonian mechanics, we can also construct structure-preserving integrators by the same procedure used to construct the symplectic integrators. In the structure-preserving integrator, however, the existence of shadow Hamiltonians is nontrivial. This is because the Nambu mechanics is driven by multiple Hamiltonians and it is nontrivial whether the time evolution by the integrator can be cast into the Nambu mechanical time evolution driven by multiple shadow Hamiltonians. In this paper we present a general procedure to calculate the shadow Hamiltonians of structure-preserving integrators for Nambu mechanics, and give an example where the shadow Hamiltonians exist. This is the first attempt to determine the concrete forms of the shadow Hamiltonians for a Nambu mechanical system. We show that the fundamental identity, which corresponds to the Jacobi identity in Hamiltonian mechanics, plays an important role in calculating the shadow Hamiltonians using the Baker-Campbell-Hausdorff formula. It turns out that the resulting shadow Hamiltonians have indefinite forms depending on how the fundamental identities are used. This is not a technical artifact, because the exact shadow Hamiltonians obtained independently have the same indefiniteness.

categories: math-ph cs.NA math.MP math.NA physics.comp-ph


title: Scattering Singularity in Topological Dielectric Photonic Crystals

abstract: The exploration of topology in natural materials and metamaterials has garnered significant attention. Notably, the one-dimensional (1D) and two-dimensional (2D) Su-Schrieffer-Heeger (SSH) model, assessed through tight-binding approximations, has been extensively investigated in both quantum and classical systems, encompassing general and higher-order topology. Despite these advancements, a comprehensive examination of these models from the perspective of wave physics, particularly the scattering view, remains underexplored. In this study, we systematically unveil the origin of the 1D and 2D Zak phases stemming from the zero-scattering point, termed the scattering singularity in k-space. Employing an expanded plane wave expansion, we accurately compute the reflective spectrum of an infinite 2D photonic crystal (2D-PhC). Analyzing the reflective spectrum reveals the presence of a zero-scattering line in the 2D-PhC, considered the topological origin of the non-trivial Zak phase. Two distinct models, representing omnidirectional non-trivial cases and directional non-trivial cases, are employed to substantiate these findings. Our work introduces a novel perspective for characterizing the nature of non-trivial topological phases. The identification of the zero-scattering line not only enhances our understanding of the underlying physics but also provides valuable insights for the design of innovative devices.


title: CRS-Diff: Controllable Generative Remote Sensing Foundation Model

abstract: The emergence of generative models has revolutionized the field of remote sensing (RS) image generation. Despite generating high-quality images, existing methods are limited in relying mainly on text control conditions and thus don't always generate images accurately and stablely. In this paper, we propose CRS-Diff, a new RS generative foundation framework specifically tailored for RS image generation, leveraging the inherent advantages of diffusion models while integrating more advanced control mechanisms. Specifically, CRS-Diff can simultaneously support text-condition, metadata-condition, and image-condition control inputs, thus enabling more precise control to refine the generation process. To effectively integrate multiple condition control information, we introduce a new conditional control mechanism to achieve multi-scale feature fusion, thus enhancing the guiding effect of control conditions. To our knowledge, CRS-Diff is the first multiple-condition controllable generative RS foundation model. Experimental results in single-condition and multiple-condition cases have demonstrated the superior ability of our CRS-Diff to generate RS images both quantitatively and qualitatively compared with previous methods. Additionally, our CRS-Diff can serve as a data engine that generates high-quality training data for downstream tasks, e.g., road extraction. The code is available at https://github.com/Sonettoo/CRS-Diff.


title: Effects of galaxy environment on merger fraction

abstract: Aims. In this work, we intend to examine how environment influences the merger fraction, from the low density field environment to higher density groups and clusters. We also aim to study how the properties of a group or cluster, as well as the position of a galaxy in the group or cluster, influences the merger fraction. Methods. We identified galaxy groups and clusters in the North Ecliptic Pole using a friends-of-friends algorithm and the local density. Once identified, we determined the central galaxies, group radii, velocity dispersions, and group masses of these groups and clusters. Merging systems were identified with a neural network as well as visually. With these, we examined how the merger fraction changes as the local density changes for all galaxies as well as how the merger fraction changes as the properties of the groups or clusters change. Results. We find that the merger fraction increases as local density increases and decreases as the velocity dispersion increases, as is often found in literature. A decrease in merger fraction as the group mass increases is also found. We also find groups with larger radii have higher merger fractions. The number of galaxies in a group does not influence the merger fraction. Conclusions. The decrease in merger fraction as group mass increases is a result of the link between group mass and velocity dispersion. Hence, this decrease of merger fraction with increasing mass is a result of the decrease of merger fraction with velocity dispersion. The increasing relation between group radii and merger fraction may be a result of larger groups having smaller velocity dispersion at a larger distance from the centre or larger groups hosting smaller, infalling groups with more mergers. However, we do not find evidence of smaller groups having higher merger fractions.


title: Multi-View Video-Based Learning: Leveraging Weak Labels for Frame-Level Perception

abstract: For training a video-based action recognition model that accepts multi-view video, annotating frame-level labels is tedious and difficult. However, it is relatively easy to annotate sequence-level labels. This kind of coarse annotations are called as weak labels. However, training a multi-view video-based action recognition model with weak labels for frame-level perception is challenging. In this paper, we propose a novel learning framework, where the weak labels are first used to train a multi-view video-based base model, which is subsequently used for downstream frame-level perception tasks. The base model is trained to obtain individual latent embeddings for each view in the multi-view input. For training the model using the weak labels, we propose a novel latent loss function. We also propose a model that uses the view-specific latent embeddings for downstream frame-level action recognition and detection tasks. The proposed framework is evaluated using the MM Office dataset by comparing several baseline algorithms. The results show that the proposed base model is effectively trained using weak labels and the latent embeddings help the downstream models improve accuracy.


title: Frontier-Based Exploration for Multi-Robot Rendezvous in Communication-Restricted Unknown Environments

abstract: Multi-robot rendezvous and exploration are fundamental challenges in the domain of mobile robotic systems. This paper addresses multi-robot rendezvous within an initially unknown environment where communication is only possible after the rendezvous. Traditionally, exploration has been focused on rapidly mapping the environment, often leading to suboptimal rendezvous performance in later stages. We adapt a standard frontier-based exploration technique to integrate exploration and rendezvous into a unified strategy, with a mechanism that allows robots to re-visit previously explored regions thus enhancing rendezvous opportunities. We validate our approach in 3D realistic simulations using ROS, showcasing its effectiveness in achieving faster rendezvous times compared to exploration strategies.


title: Current-induced magnon trapping in spin torque oscillation

abstract: Spin torque nano-oscillators realized by magnetization dynamics trapped in a current-induced potential are reported. We fabricated Ni$_{81}$Fe$_{19}$/Pt nanostructures and measured current-induced microwave emission from the structures. The result shows an increase in the magnitude and spectral narrowing of the microwave emission. We demonstrate that the current-induced magnetic field suppresses magnon radiation loss and significantly reduces the linewidth and the threshold current required for the spin torque oscillation.


title: Theoretical Study on Optoelectronic properties of Layered In2O3 and Ga2O3

abstract: Composite oxides have been indeed proved to be valuable materials in optoelectronic applications. The combination of indium oxide and gallium oxide and other materials can lead to enhanced optical and electronic properties, making them suitable for a variety of optoelectronic devices. Meticulous analysis of the various optical properties helped to draw conclusions about the heterostructure of Indium and Gallium oxide and its use as a suitable semiconducting material in the medium bandgap range. The density of states and the band structure have been obtained from the density functional theory calculations. Real frequency phonon density of states supports dynamical stability of the crystal structure. A favorable energy band gap is achieved in the visible region of the spectrum, indicating that this mixed oxide is well suited for optoelectronic devices such as LEDs and solar cells.


title: Ultracold dipolar bosons trapped in atomtronic circuits

abstract: We consider a ring-shaped triple-well potential with few polar bosons with in-plane dipole orientation. By diagonalizing the extended Bose-Hubbard Hamiltonian, we investigate the ground state properties of the system as we rotate the dipole angle and vary the on-site and dipole-dipole interaction strengths. We find that the anisotropic character of the dipolar interactions, as well as the competition between dipole and on-site interactions lead to different ground states and that the entanglement between sites also depends on the number of particles. We further characterize the system by studying the condensed fraction and coherence properties for different polarization angles, highlighting the possible effect of the dipolar interaction as manipulation tool.


title: Let's Focus on Neuron: Neuron-Level Supervised Fine-tuning for Large Language Model

abstract: Large Language Models (LLMs) are composed of neurons that exhibit various behaviors and roles, which become increasingly diversified as models scale. Recent studies have revealed that not all neurons are active across different datasets, and this sparsity correlates positively with the task-specific ability, leading to advancements in model pruning and training efficiency. Traditional fine-tuning methods engage all parameters of LLMs, which is computationally expensive and may not be necessary. In contrast, Parameter-Efficient Fine-Tuning (PEFT) approaches aim to minimize the number of trainable parameters, yet they still operate at a relatively macro scale (e.g., layer-level). We introduce Neuron-Level Fine-Tuning (NeFT), a novel approach that refines the granularity of parameter training down to the individual neuron, enabling more precise and computationally efficient model updates. The experimental results show that NeFT not only exceeded the performance of full-parameter fine-tuning and PEFT but also provided insights into the analysis of neurons.


title: Asset management with an ESG mandate

abstract: We investigate the portfolio frontier and risk premia in equilibrium when an institutional investor aims to minimize the tracking error variance and to attain an ESG score higher than the benchmark's one (ESG mandate). Provided that a negative ESG premium for stocks is priced by the market, we show that an ESG mandate can reduce the mean-variance inefficiency of the portfolio frontier when the asset manager targets a limited over-performance with respect to the benchmark. Instead, for a high over-performance target, an ESG mandate leads to a higher variance. The mean-variance improvement is due to the fact that the ESG mandate induces the asset manager to over-invest in assets with a high mean-standard deviation ratio. In equilibrium, with asset managers and mean-variance investors, a negative ESG premium arises if the ESG mandate is binding for asset managers. A result that is borne out by the data.


title: Synthesizing multi-log grasp poses

abstract: Multi-object grasping is a challenging task. It is important for energy and cost-efficient operation of industrial crane manipulators, such as those used to collect tree logs off the forest floor and onto forest machines. In this work, we used synthetic data from physics simulations to explore how data-driven modeling can be used to infer multi-object grasp poses from images. We showed that convolutional neural networks can be trained specifically for synthesizing multi-object grasps. Using RGB-Depth images and instance segmentation masks as input, a U-Net model outputs grasp maps with corresponding grapple orientation and opening width. Given an observation of a pile of logs, the model can be used to synthesize and rate the possible grasp poses and select the most suitable one, with the possibility to respect changing operational constraints such as lift capacity and reach. When tested on previously unseen data, the proposed model found successful grasp poses with an accuracy of 95%.


title: Dual-Channel Multiplex Graph Neural Networks for Recommendation

abstract: Efficient recommender systems play a crucial role in accurately capturing user and item attributes that mirror individual preferences. Some existing recommendation techniques have started to shift their focus towards modeling various types of interaction relations between users and items in real-world recommendation scenarios, such as clicks, marking favorites, and purchases on online shopping platforms. Nevertheless, these approaches still grapple with two significant shortcomings: (1) Insufficient modeling and exploitation of the impact of various behavior patterns formed by multiplex relations between users and items on representation learning, and (2) ignoring the effect of different relations in the behavior patterns on the target relation in recommender system scenarios. In this study, we introduce a novel recommendation framework, Dual-Channel Multiplex Graph Neural Network (DCMGNN), which addresses the aforementioned challenges. It incorporates an explicit behavior pattern representation learner to capture the behavior patterns composed of multiplex user-item interaction relations, and includes a relation chain representation learning and a relation chain-aware encoder to discover the impact of various auxiliary relations on the target relation, the dependencies between different relations, and mine the appropriate order of relations in a behavior pattern. Extensive experiments on three real-world datasets demonstrate that our \model surpasses various state-of-the-art recommendation methods. It outperforms the best baselines by 10.06\% and 12.15\% on average across all datasets in terms of R@10 and N@10 respectively.


title: GaussNav: Gaussian Splatting for Visual Navigation

abstract: In embodied vision, Instance ImageGoal Navigation (IIN) requires an agent to locate a specific object depicted in a goal image within an unexplored environment. The primary difficulty of IIN stems from the necessity of recognizing the target object across varying viewpoints and rejecting potential distractors. Existing map-based navigation methods largely adopt the representation form of Bird's Eye View (BEV) maps, which, however, lack the representation of detailed textures in a scene. To address the above issues, we propose a new Gaussian Splatting Navigation (abbreviated as GaussNav) framework for IIN task, which constructs a novel map representation based on 3D Gaussian Splatting (3DGS). The proposed framework enables the agent to not only memorize the geometry and semantic information of the scene, but also retain the textural features of objects. Our GaussNav framework demonstrates a significant leap in performance, evidenced by an increase in Success weighted by Path Length (SPL) from 0.252 to 0.578 on the challenging Habitat-Matterport 3D (HM3D) dataset. Our code will be made publicly available.