title: Pour me a drink: Robotic Precision Pouring Carbonated Beverages into Transparent Containers

abstract: With the growing emphasis on the development and integration of service robots within household environments, we will need to endow robots with the ability to reliably pour a variety of liquids. However, liquid handling and pouring is a challenging task due to the complex dynamics and varying properties of different liquids, the exacting precision required to prevent spills and ensure accurate pouring, and the necessity for robots to adapt seamlessly to a multitude of containers in real-world scenarios. In response to these challenges, we propose a novel autonomous robotics pipeline that empowers robots to execute precision pouring tasks, encompassing both carbonated and non-carbonated liquids, as well as opaque and transparent liquids, into a variety of transparent containers. Our proposed approach maximizes the potential of RGB input alone, achieving zero-shot capability by harnessing existing pre-trained vision segmentation models. This eliminates the need for additional data collection, manual image annotations, or extensive training. Furthermore, our work integrates ChatGPT, facilitating seamless interaction between individuals without prior expertise in robotics and our pouring pipeline, this integration enables users to effortlessly request and execute pouring actions. Our experiments demonstrate the pipeline's capability to successfully pour a diverse range of carbonated and non-carbonated beverages into containers of varying sizes, relying solely on visual input.


title: Magneto-Acoustic Waves in antiferromagnetic CuMnAs excited by Surface Acoustic Waves

abstract: Magnetoelastic effects in antiferromagnetic CuMnAs are investigated by applying dynamic strain in the 0.01% range through surface acoustic waves in the GaAs substrate. The magnetic state of the CuMnAs/GaAs is characterized by a multitude of submicron-sized domains which we image by x-ray magnetic linear dichroism combined with photoemission electron microscopy. Within the explored strain range, CuMnAs shows magnetoelastic effects in the form of N\'eel vector waves with micrometer wavelength, which corresponds to an averaged overall spin-axis rotation up to 2.4 deg driven by the time-dependent strain from the surface acoustic wave. Measurements at different temperatures indicate a reduction of the wave amplitude when lowering the temperature. However, no domain wall motion has been detected on the nanosecond timescale


title: Charged spherically symmetric black holes in scalar-tensor Gauss-Bonnet gravity

abstract: We derive a novel class of four-dimensional black hole solutions in Gauss-Bonnet gravity coupled with a scalar field in presence of Maxwell electrodynamics. In order to derive such solutions, we assume the ansatz $ g_{tt}\neq g_{rr}{}^{-1}$ for metric potentials. Due to the ansatz for the metric, the Reissner Nordstr\"om gauge potential cannot be recovered because of the presence of higher-order terms ${\cal O}\left(\frac{1}{r}\right)$ which are not allowed to be vanishing. Moreover, the scalar field is not allowed to vanish. If it vanishes, a function of the solution results undefined. For this reason, the solution cannot be reduced to a Reissner Nordstr\"om space-time in any limit. Furthermore, it is possible to show that the electric field is of higher-order in the monopole expansion: this fact explicitly comes from the contribution of the scalar field. Therefore, we can conclude that the Gauss-Bonnet scalar field acts as non-linear electrodynamics creating monopoles, quadrupoles, etc. in the metric potentials. We compute the invariants associated with the black holes and show that, when compared to Schwarzschild or Reissner-Nordstr\"om space-times, they have a soft singularity. Also, it is possible to demonstrate that these black holes give rise to three horizons in AdS space-time and two horizons in dS space-time. Finally, thermodynamic quantities can be derived and we show that the solution can be stable or unstable depending on a critical value of the temperature.


title: CDDM: Channel Denoising Diffusion Models for Wireless Semantic Communications

abstract: Diffusion models (DM) can gradually learn to remove noise, which have been widely used in artificial intelligence generated content (AIGC) in recent years. The property of DM for eliminating noise leads us to wonder whether DM can be applied to wireless communications to help the receiver mitigate the channel noise. To address this, we propose channel denoising diffusion models (CDDM) for semantic communications over wireless channels in this paper. CDDM can be applied as a new physical layer module after the channel equalization to learn the distribution of the channel input signal, and then utilizes this learned knowledge to remove the channel noise. We derive corresponding training and sampling algorithms of CDDM according to the forward diffusion process specially designed to adapt the channel models and theoretically prove that the well-trained CDDM can effectively reduce the conditional entropy of the received signal under small sampling steps. Moreover, we apply CDDM to a semantic communications system based on joint source-channel coding (JSCC) for image transmission. Extensive experimental results demonstrate that CDDM can further reduce the mean square error (MSE) after minimum mean square error (MMSE) equalizer, and the joint CDDM and JSCC system achieves better performance than the JSCC system and the traditional JPEG2000 with low-density parity-check (LDPC) code approach.


title: Graph-based Decentralized Task Allocation for Multi-Robot Target Localization

abstract: We introduce a new approach to address the task allocation problem in a system of heterogeneous robots comprising of Unmanned Ground Vehicles (UGVs) and Unmanned Aerial Vehicles (UAVs). The proposed model, \texttt{\method}, or \textbf{G}raph \textbf{A}ttention \textbf{T}ask \textbf{A}llocato\textbf{R} aggregates information from neighbors in the multi-robot system, with the aim of achieving joint optimality in the target localization efficiency.Being decentralized, our method is highly robust and adaptable to situations where collaborators may change over time, ensuring the continuity of the mission. We also proposed heterogeneity-aware preprocessing to let all the different types of robots collaborate with a uniform model.The experimental results demonstrate the effectiveness and scalability of the proposed approach in a range of simulated scenarios. The model can allocate targets' positions close to the expert algorithm's result, with a median spatial gap less than a unit length. This approach can be used in multi-robot systems deployed in search and rescue missions, environmental monitoring, and disaster response.


title: Asynchronous Task Plan Refinement for Multi-Robot Task and Motion Planning

abstract: This paper explores general multi-robot task and motion planning, where multiple robots in close proximity manipulate objects while satisfying constraints and a given goal. In particular, we formulate the plan refinement problem--which, given a task plan, finds valid assignments of variables corresponding to solution trajectories--as a hybrid constraint satisfaction problem. The proposed algorithm follows several design principles that yield the following features: (1) efficient solution finding due to sequential heuristics and implicit time and roadmap representations, and (2) maximized feasible solution space obtained by introducing minimally necessary coordination-induced constraints and not relying on prevalent simplifications that exist in the literature. The evaluation results demonstrate the planning efficiency of the proposed algorithm, outperforming the synchronous approach in terms of makespan.


title: Investigation of the Anomalous and Topological Hall Effects in Layered Monoclinic Ferromagnet Cr$_{2.76}$Te$_4$

abstract: We studied the electrical transport, Hall effect, and magnetic properties of monoclinic layered ferromagnet Cr$_{2.76}$Te$_4$. Our studies demonstrate Cr$_{2.76}$Te$_4$ to be a soft ferromagnet with strong magnetocrystalline anisotropy. Below 50 K, the system shows an antiferromagnetic-like transition. Interestingly, between 50 and 150 K, we observe fluctuating magnetic moments between in-plane and out-of-plane orientations, leading to non-coplanar spin structure. On the other hand, the electrical resistivity data suggest it to be metallic throughout the measured temperature range, except a $kink$ at around 50 K due to AFM ordering. The Rhodes-Wohlfarth ratio $\frac{\mu_{eff}}{\mu_{s}}=1.89 (>1)$ calculated from our magnetic studies confirms that Cr$_{2.76}$Te$_4$ is an itinerant ferromagnet. Large anomalous Hall effect has been observed due to the skew-scattering of impurities and the topological Hall effect has been observed due to non-coplanar spin-structure in the presence of strong magnetocrystalline anisotropy. We examined the mechanism of anomalous Hall effect by employing the first principles calculations.


title: Electrical transport in epitaxially grown undoped and Si-doped degenerate GaN films

abstract: Undoped and Si-doped GaN films were grown epitaxially on sapphire by reactive rf sputtering of GaAs (and Si) in Ar-N2 mixture. The resistivity of undoped GaN film grown at 100% N2 was ~2 x 105 {\Omega} cm, which reduced to ~1 {\Omega} cm in Si-doped film, revealing the effect of Si doping. With decrease of N2 from 100% to 75%, the carrier concentration of Si-doped films increased from ~7 x 1018 cm-3 to ~2 x 1019 cm-3, but remained practically unchanged as N2 was decreased to 20%, which is explained by effects due to saturation of Si doping and increase of Ga interstitials as well as compensation by N interstitials and Ga vacancies. Undoped and Si-doped films grown below 20% N2 displayed similar carrier concentrations (~1020 cm-3), due to dominance of Ga interstitials. Both undoped and Si-doped films were degenerate and displayed increase of mobility with carrier concentration and temperature, which was analyzed by the combined effect of ionized impurity and dislocation scattering, using compensation ratio as fitting parameter. At carrier concentrations below 1019 cm-3, the mobility was governed by both ionized impurity and dislocation scattering, while at higher carrier concentrations, ionized impurity scattering was found to dominate, limited by compensation due to acceptors. In spite of the degenerate character, the films displayed a small decrease of carrier concentration with temperature, along with a nearly linear decrease of mobility, which are explained by a marginal increase of compensation ratio with decrease of temperature, taking into account the band edge fluctuation effects.


title: Certain properties of generalized tracially approximated C*-algebras

abstract: We show that the following properties of unital ${\rm C^*}$-algebra in a class of $\Omega$ are preserved by unital simple ${\rm C^*}$-algebra in the class of $\rm WTA\Omega$: $(1)$ uniform property $\Gamma$, $(2)$ a certain type of tracial nuclear dimension at most $n$, $(3)$ weakly $(m, n)$-divisible.


title: Combinatorial curvature flows for generalized hyperbolic circle packings

abstract: Generalized circle packings were introduced in \cite{Ba-Hu-Sun} as a generalization of tangential circle packings in hyperbolic background geometry. In this paper, we introduce the combinatorial Calabi flow, fractional combinatorial Calabi flow and combinatorial $p$-th Calabi flow for generalized hyperbolic circle packings. We establish several equivalent conditions regarding the longtime behaviors of these flows. This provides effective algorithms for finding the generalized circle packings with prescribed total geodesic curvatures.


title: Investigating Subtler Biases in LLMs: Ageism, Beauty, Institutional, and Nationality Bias in Generative Models

abstract: LLMs are increasingly powerful and widely used to assist users in a variety of tasks. This use risks the introduction of LLM biases to consequential decisions such as job hiring, human performance evaluation, and criminal sentencing. Bias in NLP systems along the lines of gender and ethnicity has been widely studied, especially for specific stereotypes (e.g., Asians are good at math). In this paper, we investigate bias along less-studied but still consequential, dimensions, such as age and beauty, measuring subtler correlated decisions that LLMs make between social groups and unrelated positive and negative attributes. We ask whether LLMs hold wide-reaching biases of positive or negative sentiment for specific social groups similar to the "what is beautiful is good" bias found in people in experimental psychology. We introduce a template-generated dataset of sentence completion tasks that asks the model to select the most appropriate attribute to complete an evaluative statement about a person described as a member of a specific social group. We also reverse the completion task to select the social group based on an attribute. We report the correlations that we find for 4 cutting-edge LLMs. This dataset can be used as a benchmark to evaluate progress in more generalized biases and the templating technique can be used to expand the benchmark with minimal additional human annotation.


title: Some lattices from polynomial rings

abstract: We study some properties of the lattices defined as the kernel of the map $(a_1,\ldots, a_{q-1}) \mapsto \prod (1-c_ix)^{a_i} \in (\mathbb{F}_q[x]/(x^e))^*$, where $\mathbb{F}_q^* = \{c_1,\ldots,c_{q-1}\}$.


title: Stylized Table Tennis Robots Skill Learning with Incomplete Human Demonstrations

abstract: In recent years, Reinforcement Learning (RL) is becoming a popular technique for training controllers for robots. However, for complex dynamic robot control tasks, RL-based method often produces controllers with unrealistic styles. In contrast, humans can learn well-stylized skills under supervisions. For example, people learn table tennis skills by imitating the motions of coaches. Such reference motions are often incomplete, e.g. without the presence of an actual ball. Inspired by this, we propose an RL-based algorithm to train a robot that can learn the playing style from such incomplete human demonstrations. We collect data through the teaching-and-dragging method. We also propose data augmentation techniques to enable our robot to adapt to balls of different velocities. We finally evaluate our policy in different simulators with varying dynamics.


title: Spin dependence in the $p$-wave resonance of ${^{139}\vec{\rm{La}}+\vec{n}}$

abstract: We measured the spin dependence in a neutron-induced $p$-wave resonance by using a polarized epithermal neutron beam and a polarized nuclear target. Our study focuses on the 0.75~eV $p$-wave resonance state of $^{139}$La+$n$, where largely enhanced parity violation has been observed. We determined the partial neutron width of the $p$-wave resonance by measuring the spin dependence of the neutron absorption cross section between polarized $^{139}\rm{La}$ and polarized neutrons. Our findings serve as a foundation for the quantitative study of the enhancement effect of the discrete symmetry violations caused by mixing between partial amplitudes in the compound nuclei.


title: Scalable Multiuser Immersive Communications with Multi-numerology and Mini-slot

abstract: This paper studies multiuser immersive communications networks in which different user equipment may demand various extended reality (XR) services. In such heterogeneous networks, time-frequency resource allocation needs to be more adaptive since XR services are usually multi-modal and latency-sensitive. To this end, we develop a scalable time-frequency resource allocation method based on multi-numerology and mini-slot. To appropriately determining the discrete parameters of multi-numerology and mini-slot for multiuser immersive communications, the proposed method first presents a novel flexible time-frequency resource block configuration, then it leverages the deep reinforcement learning to maximize the total quality-of-experience (QoE) under different users' QoE constraints. The results confirm the efficiency and scalability of the proposed time-frequency resource allocation method.


title: Sampling-Based Estimates of the Sizes of Constrained Subcodes of Reed-Muller Codes

abstract: This paper develops an algorithmic approach for obtaining approximate, numerical estimates of the sizes of subcodes of Reed-Muller (RM) codes, all of the codewords in which satisfy a given constraint. Our algorithm is based on a statistical physics technique for estimating the partition functions of spin systems, which in turn makes use of a sampler that produces RM codewords according to a Gibbs distribution. The Gibbs distribution is designed so that it is biased towards codewords that respect the constraint. We apply our method to approximately compute the sizes of runlength limited (RLL) subcodes and obtain estimates of the weight distribution of moderate-blocklength RM codes. We observe that the estimates returned by our method are close to the true sizes when these sizes are either known or computable by brute-force search; in other cases, our computations provide provably robust estimates. As an illustration of our methods, we provide estimates of the weight distribution of the RM$(9,4)$ code.


title: Should we fly in the Lebesgue-designed airplane? -- The correct defence of the Lebesgue integral

abstract: It is well-known that the Lebesgue integral generalises the Riemann integral. However, as is also well-known but less frequently well-explained, this generalisation alone is not the reason why the Lebesgue integral is important and needs to be a part of the arsenal of any mathematician, pure or applied. Those who understand the correct reasons for the importance of the Lebesgue integral realise there are at least two crucial differences between the Riemann and Lebesgue theories. One is the difference between the Dominated Convergence Theorem in the two theories, and another is the completeness of the normed vector spaces of integrable functions. Here topological interpretations are provided for the differences in the Dominated Convergence Theorems, and explicit counterexamples are given which illustrate the deficiencies of the Riemann integral. Also illustrated are the deleterious consequences of the defects in the Riemann integral on Fourier transform theory if one restricts to Riemann integrable functions.


title: CARLA-Loc: Synthetic SLAM Dataset with Full-stack Sensor Setup in Challenging Weather and Dynamic Environments

abstract: The robustness of SLAM (Simultaneous Localization and Mapping) algorithms under challenging environmental conditions is critical for the success of autonomous driving. However, the real-world impact of such conditions remains largely unexplored due to the difficulty of altering environmental parameters in a controlled manner. To address this, we introduce CARLA-Loc, a synthetic dataset designed for challenging and dynamic environments, created using the CARLA simulator. Our dataset integrates a variety of sensors, including cameras, event cameras, LiDAR, radar, and IMU, etc. with tuned parameters and modifications to ensure the realism of the generated data. CARLA-Loc comprises 7 maps and 42 sequences, each varying in dynamics and weather conditions. Additionally, a pipeline script is provided that allows users to generate custom sequences conveniently. We evaluated 5 visual-based and 4 LiDAR-based SLAM algorithms across different sequences, analyzing how various challenging environmental factors influence localization accuracy. Our findings demonstrate the utility of the CARLA-Loc dataset in validating the efficacy of SLAM algorithms under diverse conditions.


title: Total-effect Test May Erroneously Reject So-called "Full" or "Complete" Mediation

abstract: The procedure for establishing mediation, i.e., determining that an independent variable X affects a dependent variable Y through some mediator M, has been under debate. The classic causal steps require that a "total effect" be significant, now also known as statistically acknowledged. It has been shown that the total-effect test can erroneously reject competitive mediation and is superfluous for establishing complementary mediation. Little is known about the last type, indirect-only mediation, aka "full" or "complete" mediation, in which the indirect (ab) path passes the statistical partition test while the direct-and-remainder (d) path fails. This study 1) provides proof that the total-effect test can erroneously reject indirect-only mediation, including both sub-types, assuming least square estimation (LSE) F-test or Sobel test; 2) provides a simulation to duplicate the mathematical proofs and extend the conclusion to LAD-Z test; 3) provides two real-data examples, one for each sub-type, to illustrate the mathematical conclusion; 4) in view of the mathematical findings, proposes to revisit concepts, theories, and techniques of mediation analysis and other causal dissection analyses, and showcase a more comprehensive alternative, process-and-product analysis (PAPA).


title: Efficient Methods for Non-stationary Online Learning

abstract: Non-stationary online learning has drawn much attention in recent years. In particular, dynamic regret and adaptive regret are proposed as two principled performance measures for online convex optimization in non-stationary environments. To optimize them, a two-layer online ensemble is usually deployed due to the inherent uncertainty of the non-stationarity, in which a group of base-learners are maintained and a meta-algorithm is employed to track the best one on the fly. However, the two-layer structure raises the concern about the computational complexity -- those methods typically maintain $\mathcal{O}(\log T)$ base-learners simultaneously for a $T$-round online game and thus perform multiple projections onto the feasible domain per round, which becomes the computational bottleneck when the domain is complicated. In this paper, we present efficient methods for optimizing dynamic regret and adaptive regret, which reduce the number of projections per round from $\mathcal{O}(\log T)$ to $1$. Moreover, our obtained algorithms require only one gradient query and one function evaluation at each round. Our technique hinges on the reduction mechanism developed in parameter-free online learning and requires non-trivial twists on non-stationary online methods. Empirical studies verify our theoretical findings.


title: Delving into Multimodal Prompting for Fine-grained Visual Classification

abstract: Fine-grained visual classification (FGVC) involves categorizing fine subdivisions within a broader category, which poses challenges due to subtle inter-class discrepancies and large intra-class variations. However, prevailing approaches primarily focus on uni-modal visual concepts. Recent advancements in pre-trained vision-language models have demonstrated remarkable performance in various high-level vision tasks, yet the applicability of such models to FGVC tasks remains uncertain. In this paper, we aim to fully exploit the capabilities of cross-modal description to tackle FGVC tasks and propose a novel multimodal prompting solution, denoted as MP-FGVC, based on the contrastive language-image pertaining (CLIP) model. Our MP-FGVC comprises a multimodal prompts scheme and a multimodal adaptation scheme. The former includes Subcategory-specific Vision Prompt (SsVP) and Discrepancy-aware Text Prompt (DaTP), which explicitly highlights the subcategory-specific discrepancies from the perspectives of both vision and language. The latter aligns the vision and text prompting elements in a common semantic space, facilitating cross-modal collaborative reasoning through a Vision-Language Fusion Module (VLFM) for further improvement on FGVC. Moreover, we tailor a two-stage optimization strategy for MP-FGVC to fully leverage the pre-trained CLIP model and expedite efficient adaptation for FGVC. Extensive experiments conducted on four FGVC datasets demonstrate the effectiveness of our MP-FGVC.


title: A Statistical Turing Test for Generative Models

abstract: The emergence of human-like abilities of AI systems for content generation in domains such as text, audio, and vision has prompted the development of classifiers to determine whether content originated from a human or a machine. Implicit in these efforts is an assumption that the generation properties of a human are different from that of the machine. In this work, we provide a framework in the language of statistical pattern recognition that quantifies the difference between the distributions of human and machine-generated content conditioned on an evaluation context. We describe current methods in the context of the framework and demonstrate how to use the framework to evaluate the progression of generative models towards human-like capabilities, among many axes of analysis.


title: Outram: One-shot Global Localization via Triangulated Scene Graph and Global Outlier Pruning

abstract: One-shot LiDAR localization refers to the ability to estimate the robot pose from one single point cloud, which yields significant advantages in initialization and relocalization processes. In the point cloud domain, the topic has been extensively studied as a global descriptor retrieval (i.e., loop closure detection) and pose refinement (i.e., point cloud registration) problem both in isolation or combined. However, few have explicitly considered the relationship between candidate retrieval and correspondence generation in pose estimation, leaving them brittle to substructure ambiguities. To this end, we propose a hierarchical one-shot localization algorithm called Outram that leverages substructures of 3D scene graphs for locally consistent correspondence searching and global substructure-wise outlier pruning. Such a hierarchical process couples the feature retrieval and the correspondence extraction to resolve the substructure ambiguities by conducting a local-to-global consistency refinement. We demonstrate the capability of Outram in a variety of scenarios in multiple large-scale outdoor datasets. Our implementation is open-sourced: https://github.com/Pamphlett/Outram.


title: On non-expandable cross-bifix-free codes

abstract: A cross-bifix-free code of length $n$ over $\mathbb{Z}_q$ is defined as a non-empty subset of $\mathbb{Z}_q^n$ satisfying that the prefix set of each codeword is disjoint from the suffix set of every codeword. Cross-bifix-free codes have found important applications in digital communication systems. One of the main research problems on cross-bifix-free codes is to construct cross-bifix-free codes as large as possible in size. Recently, Wang and Wang introduced a family of cross-bifix-free codes $S_{I,J}^{(k)}(n)$, which is a generalization of the classical cross-bifix-free codes studied early by Lvenshtein, Gilbert and Chee {\it et al.}. It is known that $S_{I,J}^{(k)}(n)$ is nearly optimal in size and $S_{I,J}^{(k)}(n)$ is non-expandable if $k=n-1$ or $1\leq k<n/2$. In this paper, we first show that $S_{I,J}^{(k)}(n)$ is non-expandable if and only if $k=n-1$ or $1\leq k<n/2$, thereby improving the results in [Chee {\it et al.}, IEEE-TIT, 2013] and [Wang and Wang, IEEE-TIT, 2022]. We then construct a new family of cross-bifix-free codes $U^{(t)}_{I,J}(n)$ to expand $S_{I,J}^{(k)}(n)$ such that the resulting larger code $S_{I,J}^{(k)}(n)\bigcup U^{(t)}_{I,J}(n)$ is a non-expandable cross-bifix-free code whenever $S_{I,J}^{(k)}(n)$ is expandable. Finally, we present an explicit formula for the size of $S_{I,J}^{(k)}(n)\bigcup U^{(t)}_{I,J}(n)$.


title: BGGAN: Generative AI Enables Representing Brain Structure-Function Connections for Alzheimer's Disease

abstract: The relationship between brain structure and function is critical for revealing the pathogenesis of brain disease, including Alzheimer's disease (AD). However, it is a great challenge to map brain structure-function connections due to various reasons. In this work, a bidirectional graph generative adversarial networks (BGGAN) is proposed to represent brain structure-function connections. Specifically, by designing a module incorporating inner graph convolution network (InnerGCN), the generators of BGGAN can employ features of direct and indirect brain regions to learn the mapping function between structural domain and functional domain. Besides, a new module named Balancer is designed to counterpoise the optimization between generators and discriminators. By introducing the Balancer into BGGAN, both the structural generator and functional generator can not only alleviate the issue of mode collapse but also learn complementarity of structural and functional features. Experimental results using ADNI datasets show that the both the generated structure connections and generated function connections can improve the identification accuracy of AD. More importantly, based the proposed model, it is found that the relationship between brain structure and function is not a complete one-to-one correspondence. Brain structure is the basis of brain function. The strong structural connections are almost accompanied by strong functional connections.


title: On the UV/IR mixing of Lie algebra-type noncommutatitive $\phi^4$-theories

abstract: We show that a UV divergence of the propagator integral implies the divergences of the UV/IR mixing in the two-point function at one-loop for a $\phi^4$-theory on a generic Lie algebra-type noncommutative space-time. The UV/IR mixing is defined as a UV divergence of the planar contribution and an IR singularity of the non-planar contribution, the latter being due to the former UV divergence, and the UV finiteness of the non-planar contribution. Some properties of this general treatment are discussed. The UV finiteness of the non-planar contribution and the renormalizability of the theory are not treated but commented. Applications are performed for the Moyal space, having a UV/IR mixing, and the $\kappa$-Minkowski space for which the two-point function at one-loop is finite.


title: Exploration of TPUs for AI Applications

abstract: Tensor Processing Units (TPUs) are specialized hardware accelerators for deep learning developed by Google. This paper aims to explore TPUs in cloud and edge computing focusing on its applications in AI. We provide an overview of TPUs, their general architecture, specifically their design in relation to neural networks, compilation techniques and supporting frameworks. Furthermore, we provide a comparative analysis of Cloud and Edge TPU performance against other counterpart chip architectures. Our results show that TPUs can provide significant performance improvements in both cloud and edge computing. Additionally, this paper underscores the imperative need for further research in optimization techniques for efficient deployment of AI architectures on the Edge TPU and benchmarking standards for a more robust comparative analysis in edge computing scenarios. The primary motivation behind this push for research is that efficient AI acceleration, facilitated by TPUs, can lead to substantial savings in terms of time, money, and environmental resources.


title: Pixel Adapter: A Graph-Based Post-Processing Approach for Scene Text Image Super-Resolution

abstract: Current Scene text image super-resolution approaches primarily focus on extracting robust features, acquiring text information, and complex training strategies to generate super-resolution images. However, the upsampling module, which is crucial in the process of converting low-resolution images to high-resolution ones, has received little attention in existing works. To address this issue, we propose the Pixel Adapter Module (PAM) based on graph attention to address pixel distortion caused by upsampling. The PAM effectively captures local structural information by allowing each pixel to interact with its neighbors and update features. Unlike previous graph attention mechanisms, our approach achieves 2-3 orders of magnitude improvement in efficiency and memory utilization by eliminating the dependency on sparse adjacency matrices and introducing a sliding window approach for efficient parallel computation. Additionally, we introduce the MLP-based Sequential Residual Block (MSRB) for robust feature extraction from text images, and a Local Contour Awareness loss ($\mathcal{L}_{lca}$) to enhance the model's perception of details. Comprehensive experiments on TextZoom demonstrate that our proposed method generates high-quality super-resolution images, surpassing existing methods in recognition accuracy. For single-stage and multi-stage strategies, we achieved improvements of 0.7\% and 2.6\%, respectively, increasing the performance from 52.6\% and 53.7\% to 53.3\% and 56.3\%. The code is available at https://github.com/wenyu1009/RTSRN.


title: New bounds for $b$-Symbol Distances of Matrix Product Codes

abstract: Matrix product codes are generalizations of some well-known constructions of codes, such as Reed-Muller codes, $[u+v,u-v]$-construction, etc. Recently, a bound for the symbol-pair distance of a matrix product code was given in \cite{LEL}, and new families of MDS symbol-pair codes were constructed by using this bound. In this paper, we generalize this bound to the $b$-symbol distance of a matrix product code and determine all minimum $b$-symbol distances of Reed-Muller codes. We also give a bound for the minimum $b$-symbol distance of codes obtained from the $[u+v,u-v]$-construction, and use this bound to construct some $[2n,2n-2]_q$-linear $b$-symbol almost MDS codes with arbitrary length. All the minimum $b$-symbol distances of $[n,n-1]_q$-linear codes and $[n,n-2]_q$-linear codes for $1\leq b\leq n$ are determined. Some examples are presented to illustrate these results.


title: Diminishing Mott gap by doping electrons through depositing one monolayer thin film of Rb on Ca$_{2}$CuO$_{2}$Cl$_{2}$

abstract: Understanding the doping evolution from a Mott insulator to a superconductor probably holds the key for resolving the mystery of unconventional superconductivity in copper oxides. To elucidate the evolution of the electronic state starting from the Mott insulator, we dose the surface of the parent phase Ca$_{2}$CuO$_{2}$Cl$_{2}$ by depositing one monolayer thin film of Rb atoms which are supposed to donate electrons to the CuO$_{2}$ planes underneath. We successfully achieved the Rb thin films with periodic structures, and the scanning tunneling microscopy or spectroscopy (STM or STS) measurements on the surface show that the Fermi energy is pinned within the Mott gap but more close to the edge of the charge transfer band (CTB). However, the electron doping does not reduce the spectra weight of the upper Hubbard band (UHB) for the double occupancy as expected from the rigid model, but instead increase it; meanwhile, further doping will create a new wide spread in gap states derivative from the UHB, and the Mott gap will be significantly diminished. Our results provide new clues to understand the strong correlation effect of parent Mott insulators for cuprates and shed new light on the origin of high-temperature superconductivity.


title: Multimodal Multi-Hop Question Answering Through a Conversation Between Tools and Efficiently Finetuned Large Language Models

abstract: We employ a tool-interacting divide-and-conquer strategy enabling large language models (LLMs) to answer complex multimodal multi-hop questions. In particular, we harness the power of large language models to divide a given multimodal multi-hop question into unimodal single-hop sub-questions to be answered by the appropriate tool from a predefined set of tools. After all corresponding tools provide the LLM with their answers, the LLM generates the next relevant unimodal single-hop question. To increase the reasoning ability of LLMs, we prompt chatGPT to generate a tool-interacting divide-and-conquer dataset. This dataset is then used to efficiently finetune the corresponding LLM. To assess the effectiveness of this approach, we conduct an evaluation on two recently introduced complex question-answering datasets. The experimental analysis demonstrate substantial improvements over existing state-of-the-art solutions, indicating the efficacy and generality of our strategy


title: Fast Approximation of the Shapley Values Based on Order-of-Addition Experimental Designs

abstract: Shapley value is originally a concept in econometrics to fairly distribute both gains and costs to players in a coalition game. In the recent decades, its application has been extended to other areas such as marketing, engineering and machine learning. For example, it produces reasonable solutions for problems in sensitivity analysis, local model explanation towards the interpretable machine learning, node importance in social network, attribution models, etc. However, its heavy computational burden has been long recognized but rarely investigated. Specifically, in a $d$-player coalition game, calculating a Shapley value requires the evaluation of $d!$ or $2^d$ marginal contribution values, depending on whether we are taking the permutation or combination formulation of the Shapley value. Hence it becomes infeasible to calculate the Shapley value when $d$ is reasonably large. A common remedy is to take a random sample of the permutations to surrogate for the complete list of permutations. We find an advanced sampling scheme can be designed to yield much more accurate estimation of the Shapley value than the simple random sampling (SRS). Our sampling scheme is based on combinatorial structures in the field of design of experiments (DOE), particularly the order-of-addition experimental designs for the study of how the orderings of components would affect the output. We show that the obtained estimates are unbiased, and can sometimes deterministically recover the original Shapley value. Both theoretical and simulations results show that our DOE-based sampling scheme outperforms SRS in terms of estimation accuracy. Surprisingly, it is also slightly faster than SRS. Lastly, real data analysis is conducted for the C. elegans nervous system and the 9/11 terrorist network.


title: Analysis and Extraction of Tempo-Spatial Events in an Efficient Archival CDN with Emphasis on Telegram

abstract: This paper presents an efficient archival framework for exploring and tracking cyberspace large-scale data called Tempo-Spatial Content Delivery Network (TS-CDN). Social media data streams are renewing in time and spatial dimensions. Various types of websites and social networks (i.e., channels, groups, pages, etc.) are considered spatial in cyberspace. Accurate analysis entails encompassing the bulk of data. In TS-CDN by applying the hash function on big data an efficient content delivery network is created. Using hash function rebuffs data redundancy and leads to conclude unique data archive in large-scale. This framework based on entered query allows for apparent monitoring and exploring data in tempo-spatial dimension based on TF-IDF score. Also by conformance from i18n standard, the Unicode problem has been dissolved. For evaluation of TS-CDN framework, a dataset from Telegram news channels from March 23, 2020 (1399-01-01), to September 21, 2020 (1399-06-31) on topics including Coronavirus (COVID-19), vaccine, school reopening, flood, earthquake, justice shares, petroleum, and quarantine exploited. By applying hash on Telegram dataset in the mentioned time interval, a significant reduction in media files such as 39.8% for videos (from 79.5 GB to 47.8 GB), and 10% for images (from 4 GB to 3.6 GB) occurred. TS-CDN infrastructure in a web-based approach has been presented as a service-oriented system. Experiments conducted on enormous time series data, including different spatial dimensions (i.e., Khabare Fouri, Khabarhaye Fouri, Akhbare Rouze Iran, and Akhbare Rasmi Telegram news channels), demonstrate the efficiency and applicability of the implemented TS-CDN framework.


title: DOMAIN: MilDly COnservative Model-BAsed OfflINe Reinforcement Learning

abstract: Model-based reinforcement learning (RL), which learns environment model from offline dataset and generates more out-of-distribution model data, has become an effective approach to the problem of distribution shift in offline RL. Due to the gap between the learned and actual environment, conservatism should be incorporated into the algorithm to balance accurate offline data and imprecise model data. The conservatism of current algorithms mostly relies on model uncertainty estimation. However, uncertainty estimation is unreliable and leads to poor performance in certain scenarios, and the previous methods ignore differences between the model data, which brings great conservatism. Therefore, this paper proposes a milDly cOnservative Model-bAsed offlINe RL algorithm (DOMAIN) without estimating model uncertainty to address the above issues. DOMAIN introduces adaptive sampling distribution of model samples, which can adaptively adjust the model data penalty. In this paper, we theoretically demonstrate that the Q value learned by the DOMAIN outside the region is a lower bound of the true Q value, the DOMAIN is less conservative than previous model-based offline RL algorithms and has the guarantee of security policy improvement. The results of extensive experiments show that DOMAIN outperforms prior RL algorithms on the D4RL dataset benchmark, and achieves better performance than other RL algorithms on tasks that require generalization.


title: Rescaled SIR epidemic processes converge to super-Brownian motion in four or more dimensions

abstract: In dimensions $d\geq 4$, by choosing a suitable scaling parameter, we show that the rescaled spatial SIR epidemic process converges to a super-Brownian motion with drift, thus complementing the previous results by Lalley (Probab. Theory Related Fields,144(2009),429--469) and Lalley-Zheng (Prob. Th. Rel. Fields,148(2010),527--566) on the convergence of SIR epidemics in $d\leq 3$. The scaling parameters we choose also agree with the corresponding asymptotics for the critical probability $p_c$ of the range-$R$ bond percolation on $\mathbb{Z}^d$ as $R\to \infty$.


title: DynaMoN: Motion-Aware Fast and Robust Camera Localization for Dynamic Neural Radiance Fields

abstract: The accurate reconstruction of dynamic scenes with neural radiance fields is significantly dependent on the estimation of camera poses. Widely used structure-from-motion pipelines encounter difficulties in accurately tracking the camera trajectory when faced with separate dynamics of the scene content and the camera movement. To address this challenge, we propose DynaMoN. DynaMoN utilizes semantic segmentation and generic motion masks to handle dynamic content for initial camera pose estimation and statics-focused ray sampling for fast and accurate novel-view synthesis. Our novel iterative learning scheme switches between training the NeRF and updating the pose parameters for an improved reconstruction and trajectory estimation quality. The proposed pipeline shows significant acceleration of the training process. We extensively evaluate our approach on two real-world dynamic datasets, the TUM RGB-D and the BONN RGB-D Dynamic dataset. DynaMoN improves over the state-of-the-art both in terms of reconstruction quality and trajectory accuracy. We plan to make our code public to enhance research in this area.


title: In-Style: Bridging Text and Uncurated Videos with Style Transfer for Text-Video Retrieval

abstract: Large-scale noisy web image-text datasets have been proven to be efficient for learning robust vision-language models. However, when transferring them to the task of video retrieval, models still need to be fine-tuned on hand-curated paired text-video data to adapt to the diverse styles of video descriptions. To address this problem without the need for hand-annotated pairs, we propose a new setting, text-video retrieval with uncurated & unpaired data, that during training utilizes only text queries together with uncurated web videos without any paired text-video data. To this end, we propose an approach, In-Style, that learns the style of the text queries and transfers it to uncurated web videos. Moreover, to improve generalization, we show that one model can be trained with multiple text styles. To this end, we introduce a multi-style contrastive training procedure that improves the generalizability over several datasets simultaneously. We evaluate our model on retrieval performance over multiple datasets to demonstrate the advantages of our style transfer framework on the new task of uncurated & unpaired text-video retrieval and improve state-of-the-art performance on zero-shot text-video retrieval.


title: Leveraging Multi-lingual Positive Instances in Contrastive Learning to Improve Sentence Embedding

abstract: Learning multi-lingual sentence embeddings is a fundamental task in natural language processing. Recent trends in learning both mono-lingual and multi-lingual sentence embeddings are mainly based on contrastive learning (CL) among an anchor, one positive, and multiple negative instances. In this work, we argue that leveraging multiple positives should be considered for multi-lingual sentence embeddings because (1) positives in a diverse set of languages can benefit cross-lingual learning, and (2) transitive similarity across multiple positives can provide reliable structural information for learning. In order to investigate the impact of multiple positives in CL, we propose a novel approach, named MPCL, to effectively utilize multiple positive instances to improve the learning of multi-lingual sentence embeddings. Experimental results on various backbone models and downstream tasks demonstrate that MPCL leads to better retrieval, semantic similarity, and classification performances compared to conventional CL. We also observe that in unseen languages, sentence embedding models trained on multiple positives show better cross-lingual transfer performance than models trained on a single positive instance.


title: Radial Outflow Explains the Rotation Curves of Disk Galaxies

abstract: The circular velocities of the inner region of disk galaxies are predicted by standard physics but velocities beyond the stellar disks are not consistent with Newtonian physics if the material there is in stable circular orbits. However, this material is not gravitationally bound and so does not trace the gravitational field in the way that is usually assumed. The gravitational attraction near the edge of a flattened mass distribution is significantly greater than that of an equal mass in a spherical distribution. The size of the effect depends on the specifics of the mass distribution but is greater than a factor of two for reasonable models. In fact, the circular velocity can exceed the escape velocity so that these galaxies are gravitationally unstable in way not previously considered and disk material is lost due to thermal escape, bars or other disturbances. The nearly constant velocity observed in the outer disk region has been interpreted to mean that the dynamical mass of galaxies is much larger than the observed mass. In fact, there is no great discrepancy and no need to invoke dark matter at these scales. The gravitational field of a disk galaxy is determined at all radii by the observed mass. In the region of the stellar disk, stars and gas move in nearly circular orbits at velocities consistent with the gravitational field. In the outer regions the gravitational force drops rapidly so that stars and gas move outward almost unaffected by the attraction of the host galaxy.


title: A Novel Neural-symbolic System under Statistical Relational Learning

abstract: A key objective in field of artificial intelligence is to develop cognitive models that can exhibit human-like intellectual capabilities. One promising approach to achieving this is through neural-symbolic systems, which combine the strengths of deep learning and symbolic reasoning. However, current approaches in this area have been limited in their combining way, generalization and interpretability. To address these limitations, we propose a general bi-level probabilistic graphical reasoning framework called GBPGR. This framework leverages statistical relational learning to effectively integrate deep learning models and symbolic reasoning in a mutually beneficial manner. In GBPGR, the results of symbolic reasoning are utilized to refine and correct the predictions made by the deep learning models. At the same time, the deep learning models assist in enhancing the efficiency of the symbolic reasoning process. Through extensive experiments, we demonstrate that our approach achieves high performance and exhibits effective generalization in both transductive and inductive tasks.


title: Semantics-aware LiDAR-Only Pseudo Point Cloud Generation for 3D Object Detection

abstract: Although LiDAR sensors are crucial for autonomous systems due to providing precise depth information, they struggle with capturing fine object details, especially at a distance, due to sparse and non-uniform data. Recent advances introduced pseudo-LiDAR, i.e., synthetic dense point clouds, using additional modalities such as cameras to enhance 3D object detection. We present a novel LiDAR-only framework that augments raw scans with denser pseudo point clouds by solely relying on LiDAR sensors and scene semantics, omitting the need for cameras. Our framework first utilizes a segmentation model to extract scene semantics from raw point clouds, and then employs a multi-modal domain translator to generate synthetic image segments and depth cues without real cameras. This yields a dense pseudo point cloud enriched with semantic information. We also introduce a new semantically guided projection method, which enhances detection performance by retaining only relevant pseudo points. We applied our framework to different advanced 3D object detection methods and reported up to 2.9% performance upgrade. We also obtained comparable results on the KITTI 3D object detection dataset, in contrast to other state-of-the-art LiDAR-only detectors.


title: Is This a New Class of Matrices?

abstract: We consider a new class of matrices associated to a real square matrix $A$ and to a vector $\vec{c} \in \{-1,1\}^n$ such that $c_1=1$ by using a map $\varphi_{\vec{c}}$ which turns out to be a conjugation of a matrix $A$ by a signature matrix. It is shown that every such matrix is similar and congruent to a matrix $A$ and that they have same permanental polynomials. There are $2^{n-1}$ maps $\varphi_{\vec{c}}$ and they form an abelian group under the composition of maps isomorphic to the group $({\mathbb{Z}_2}^{n-1}, +)$. A decomposition of matrices, on a symmetric and antisymmetric matrix under a map $\varphi_{\vec{c}}$, is considered. Particularly, it is shown that sum of all principal minors of the order two of a matrix $A$ is equal to the sum of all principal minors of the order two of their symmetric and antisymmetric parts. It is shown that any symmetric matrix and any antisymmetric matrix under the map $\varphi_{\vec{c}}$ are simultaneously permutation similar to certain block matrices which have two blocks. Finally, for a fixed matrix $A$, it is proved that the number of different matrices $\varphi_{\vec{c}}(A)$ is $2^{n-t}$, where $t$ is the number of connected components of the graph $G$ whose adjacency matrix is $A$.


title: A Cholesky decomposition-based implementation of relativistic two-component coupled-cluster methods for medium-sized molecules

abstract: A Cholesky decomposition (CD)-based implementation of relativistic two-component coupled-cluster (CC) and equation-of-motion CC (EOM-CC) methods using an exact two-component Hamiltonian augmented with atomic-mean-field spin-orbit integrals (the X2CAMF scheme) is reported. The present CD-based implementation of X2CAMF-CC and EOM-CC methods employs atomic-orbital-based algorithms to avoid the construction of two-electron integrals and intermediates involving three and four virtual indices. Our CD-based implementation extends the applicability of X2CAMF-CC and EOM-CC methods to medium-sized molecules with the possibility to correlate around 1000 spinors. Benchmark calculations for uranium-containing small molecules have been performed to assess the dependence of the CC results on the Cholesky threshold. A Cholesky threshold of $10^{-4}$ is shown to be sufficient to maintain chemical accuracy. Example calculations to illustrate the capability of the CD-based relativistic CC methods are reported for the bond-dissociation energy of the uranium hexafluoride molecule, UF$_6$, with up to quadruple-zeta basis sets, and the lowest excitation energy in solvated uranyl ion [UO$_2^{2+}$(H$_2$O)$_{12}$].


title: Active Jamming at Criticality

abstract: Jamming is ubiquitous in disordered systems, but the critical behavior of jammed solids subjected to active forces or thermal fluctuations remains elusive. In particular, while passive athermal jamming remains mean-field-like in two and three dimensions, diverse active matter systems exhibit anomalous scaling behavior in all physical dimensions. It is therefore natural to ask whether activity leads to anomalous scaling in jammed systems. Here, we use numerical and analytical methods to study systems of active, soft, frictionless spheres in two dimensions, and elucidate the universal scaling behavior that relates the excess coordination, active forces or temperature, and pressure close to the athermal jammed point. We show that active forces and thermal effects around the critical jammed state can again be captured by a mean-field picture, thus highlighting the distinct and crucial role of amorphous structure in active matter systems.


title: Localization with Noisy Android Raw GNSS Measurements

abstract: Android raw Global Navigation Satellite System (GNSS) measurements are expected to bring smartphones power to take on demanding localization tasks that are traditionally performed by specialized GNSS receivers. The hardware constraints, however, make Android raw GNSS measurements much noisier than geodetic-quality ones. This study elucidates the principles of localization using Android raw GNSS measurements and leverages Moving Horizon Estimation (MHE), Extended Kalman Filter (EKF), and Rauch-Tung-Striebel (RTS) smoother for noise suppression. Experimental results show that the RTS smoother achieves the best positioning performance, with horizontal positioning errors significantly reduced by 76.4% and 46.5% in static and dynamic scenarios compared with the baseline weighted least squares (WLS) method. Our codes are available at https://github.com/ailocar/androidGnss.


title: Machine-Learned Potential Energy Surfaces for Free Sodium Clusters with Density Functional Accuracy: Applications to Melting

abstract: Gaussian Process Regression-based Gaussian Approximation Potential has been used to develop machine-learned interatomic potentials having density-functional accuracy for free sodium clusters. The training data was generated from a large sample of over 100,000 data points computed for clusters in the size range of N = 40 - 200, using the density-functional method as implemented in the VASP package. Two models have been developed, model M1 using data for N=55 only, and model M2 using additional data from larger clusters. The models are intended for computing thermodynamic properties using molecular dynamics. Hence, particular attention has been paid to improve the fitting of the forces. Interestingly, it turns out that the best fit can be obtained by carefully selecting a smaller number of data points viz. 1,900 and 1,300 configurations, respectively, for the two models M1 and M2. Although it was possible to obtain a good fit using the data of Na55 only, additional data points from larger clusters were needed to get better accuracies in energies and forces for larger sizes. Surprisingly, the model M1 could be significantly improved by adding about 50 data points per cluster from the larger sizes. Both models have been deployed to compute the heat capacities of Na55 and Na147 and to obtain about 40 isomers for larger clusters of sizes N = 147, 200, 201, and 252. There is an excellent agreement between the computed and experimentally measured melting temperatures. The geometries of these isomers when further optimized by DFT, the mean absolute error in the energies between DFT results and those of our models is about 7 meV/atom or less. The errors in the interatomic bond lengths are estimated to be below 2% in almost all the cases.

categories: physics.atm-clus cond-mat.mes-hall cond-mat.mtrl-sci physics.chem-ph physics.comp-ph


title: Emergent phases in graphene flat bands

abstract: Electronic correlations in two-dimensional materials play a crucial role in stabilising emergent phases of matter. The realisation of correlation-driven phenomena in graphene has remained a longstanding goal, primarily due to the absence of strong electron-electron interactions within its low-energy bands. In this context, magic-angle twisted bilayer graphene has recently emerged as a novel platform featuring correlated phases favoured by the low-energy flat bands of the underlying moir\'e superlattice. Notably, the observation of correlated insulators and superconductivity has garnered significant attention, leading to substantial progress in theoretical and experimental studies aiming to elucidate the origin and interplay between these two phases. A wealth of correlated phases with unprecedented tunability was discovered subsequently, including orbital ferromagnetism, Chern insulators, strange metallicity, density waves, and nematicity. However, a comprehensive understanding of these closely competing phases remains elusive. The ability to controllably twist and stack multiple graphene layers has enabled the creation of a whole new family of moir\'e superlattices with myriad properties being discovered at a fast pace. Here, we review the progress and development achieved so far, encompassing the rich phase diagrams offered by these graphene-based moir\'e systems. Additionally, we discuss multiple phases recently observed in non-moir\'e multilayer graphene systems. Finally, we outline future opportunities and challenges for the exploration of hidden phases in this new generation of moir\'e materials.


title: An Unified Search and Recommendation Foundation Model for Cold-Start Scenario

abstract: In modern commercial search engines and recommendation systems, data from multiple domains is available to jointly train the multi-domain model. Traditional methods train multi-domain models in the multi-task setting, with shared parameters to learn the similarity of multiple tasks, and task-specific parameters to learn the divergence of features, labels, and sample distributions of individual tasks. With the development of large language models, LLM can extract global domain-invariant text features that serve both search and recommendation tasks. We propose a novel framework called S\&R Multi-Domain Foundation, which uses LLM to extract domain invariant features, and Aspect Gating Fusion to merge the ID feature, domain invariant text features and task-specific heterogeneous sparse features to obtain the representations of query and item. Additionally, samples from multiple search and recommendation scenarios are trained jointly with Domain Adaptive Multi-Task module to obtain the multi-domain foundation model. We apply the S\&R Multi-Domain foundation model to cold start scenarios in the pretrain-finetune manner, which achieves better performance than other SOTA transfer learning methods. The S\&R Multi-Domain Foundation model has been successfully deployed in Alipay Mobile Application's online services, such as content query recommendation and service card recommendation, etc.


title: Equation of State of Charged Rod Dispersions

abstract: We study the accuracy of the theory of Stroobants, Lekkerkerker and Odijk, called SLO theory (Macromolecules 19 (1986) 2232-2238), to describe the thermodynamic properties of an isotropic fluid of charged rods. By incorporation of the effective diameter of the rods according to SLO theory into scaled particle theory (SPT) we obtain an expression for the rod concentration-dependent free volume fraction and the osmotic pressure of a collection of charged hard spherocylinders. The results are compared to Monte Carlo simulations. We find close agreement between the simulation results and the SLO-SPT predictions for not too large values of the Debye length and for high rod charge densities. The deviations increase with rod density, particularly at concentrations above which isotropic-nematic phase transitions are expected.


title: Quantum Pseudorandom Scramblers

abstract: Quantum pseudorandom state generators (PRSGs) have stimulated exciting developments in recent years. A PRSG, on a fixed initial (e.g., all-zero) state, produces an output state that is computationally indistinguishable from a Haar random state. However, pseudorandomness of the output state is not guaranteed on other initial states. In fact, known PRSG constructions provably fail on some initial state. In this work, we propose and construct quantum Pseudorandom State Scramblers (PRSSs), which can produce a pseudorandom state on an arbitrary initial state. In the information-theoretical setting, we obtain a scrambler which maps an arbitrary initial state to a distribution of quantum states that is close to Haar random in total variation distance. As a result, our PRSS exhibits a dispersing property. Loosely, it can span an $\epsilon$-net of the state space. This significantly strengthens what standard PRSGs can induce, as they may only concentrate on a small region of the state space as long as the average output state approximates a Haar random state in total variation distance. Our PRSS construction develops a parallel extension of the famous Kac's walk, and we show that it mixes exponentially faster than the standard Kac's walk. This constitutes the core of our proof. We also describe a few applications of PRSSs. While our PRSS construction assumes a post-quantum one-way function, PRSSs are potentially a weaker primitive and can be separated from one-way functions in a relativized world similar to standard PRSGs.


title: AffordPose: A Large-scale Dataset of Hand-Object Interactions with Affordance-driven Hand Pose

abstract: How human interact with objects depends on the functional roles of the target objects, which introduces the problem of affordance-aware hand-object interaction. It requires a large number of human demonstrations for the learning and understanding of plausible and appropriate hand-object interactions. In this work, we present AffordPose, a large-scale dataset of hand-object interactions with affordance-driven hand pose. We first annotate the specific part-level affordance labels for each object, e.g. twist, pull, handle-grasp, etc, instead of the general intents such as use or handover, to indicate the purpose and guide the localization of the hand-object interactions. The fine-grained hand-object interactions reveal the influence of hand-centered affordances on the detailed arrangement of the hand poses, yet also exhibit a certain degree of diversity. We collect a total of 26.7K hand-object interactions, each including the 3D object shape, the part-level affordance label, and the manually adjusted hand poses. The comprehensive data analysis shows the common characteristics and diversity of hand-object interactions per affordance via the parameter statistics and contacting computation. We also conduct experiments on the tasks of hand-object affordance understanding and affordance-oriented hand-object interaction generation, to validate the effectiveness of our dataset in learning the fine-grained hand-object interactions. Project page: https://github.com/GentlesJan/AffordPose.


title: Contextual Label Projection for Cross-Lingual Structured Prediction

abstract: Label projection, which involves obtaining translated labels and texts jointly, is essential for leveraging machine translation to facilitate cross-lingual transfer in structured prediction tasks. Prior research exploring label projection often compromise translation accuracy by favoring simplified label translation or relying solely on word-level alignments. In this paper, we introduce a novel label projection approach, CLaP, which translates text to the target language and performs contextual translation on the labels using the translated text as the context, ensuring better accuracy for the translated labels. We leverage instruction-tuned language models with multilingual capabilities as our contextual translator, imposing the constraint of the presence of translated labels in the translated text via instructions. We benchmark CLaP with other label projection techniques on zero-shot cross-lingual transfer across 39 languages on two representative structured prediction tasks - event argument extraction (EAE) and named entity recognition (NER), showing over 2.4 F1 improvement for EAE and 1.4 F1 improvement for NER. We further explore the applicability of CLaP on ten extremely low-resource languages to showcase its potential for cross-lingual structured prediction.


title: Universal Metric Learning with Parameter-Efficient Transfer Learning

abstract: A common practice in metric learning is to train and test an embedding model for each dataset. This dataset-specific approach fails to simulate real-world scenarios that involve multiple heterogeneous distributions of data. In this regard, we introduce a novel metric learning paradigm, called Universal Metric Learning (UML), which learns a unified distance metric capable of capturing relations across multiple data distributions. UML presents new challenges, such as imbalanced data distribution and bias towards dominant distributions. To address these challenges, we propose Parameter-efficient Universal Metric leArning (PUMA), which consists of a pre-trained frozen model and two additional modules, stochastic adapter and prompt pool. These modules enable to capture dataset-specific knowledge while avoiding bias towards dominant distributions. Additionally, we compile a new universal metric learning benchmark with a total of 8 different datasets. PUMA outperformed the state-of-the-art dataset-specific models while using about 69 times fewer trainable parameters.


title: Inverse classification with logistic and softmax classifiers: efficient optimization

abstract: In recent years, a certain type of problems have become of interest where one wants to query a trained classifier. Specifically, one wants to find the closest instance to a given input instance such that the classifier's predicted label is changed in a desired way. Examples of these ``inverse classification'' problems are counterfactual explanations, adversarial examples and model inversion. All of them are fundamentally optimization problems over the input instance vector involving a fixed classifier, and it is of interest to achieve a fast solution for interactive or real-time applications. We focus on solving this problem efficiently for two of the most widely used classifiers: logistic regression and softmax classifiers. Owing to special properties of these models, we show that the optimization can be solved in closed form for logistic regression, and iteratively but extremely fast for the softmax classifier. This allows us to solve either case exactly (to nearly machine precision) in a runtime of milliseconds to around a second even for very high-dimensional instances and many classes.


title: Reducing Memory Requirements for the IPU using Butterfly Factorizations

abstract: High Performance Computing (HPC) benefits from different improvements during last decades, specially in terms of hardware platforms to provide more processing power while maintaining the power consumption at a reasonable level. The Intelligence Processing Unit (IPU) is a new type of massively parallel processor, designed to speedup parallel computations with huge number of processing cores and on-chip memory components connected with high-speed fabrics. IPUs mainly target machine learning applications, however, due to the architectural differences between GPUs and IPUs, especially significantly less memory capacity on an IPU, methods for reducing model size by sparsification have to be considered. Butterfly factorizations are well-known replacements for fully-connected and convolutional layers. In this paper, we examine how butterfly structures can be implemented on an IPU and study their behavior and performance compared to a GPU. Experimental results indicate that these methods can provide 98.5% compression ratio to decrease the immense need for memory, the IPU implementation can benefit from 1.3x and 1.6x performance improvement for butterfly and pixelated butterfly, respectively. We also reach to 1.62x training time speedup on a real-word dataset such as CIFAR10.


title: Staged Contact-Aware Global Human Motion Forecasting

abstract: Scene-aware global human motion forecasting is critical for manifold applications, including virtual reality, robotics, and sports. The task combines human trajectory and pose forecasting within the provided scene context, which represents a significant challenge. So far, only Mao et al. NeurIPS'22 have addressed scene-aware global motion, cascading the prediction of future scene contact points and the global motion estimation. They perform the latter as the end-to-end forecasting of future trajectories and poses. However, end-to-end contrasts with the coarse-to-fine nature of the task and it results in lower performance, as we demonstrate here empirically. We propose a STAGed contact-aware global human motion forecasting STAG, a novel three-stage pipeline for predicting global human motion in a 3D environment. We first consider the scene and the respective human interaction as contact points. Secondly, we model the human trajectory forecasting within the scene, predicting the coarse motion of the human body as a whole. The third and last stage matches a plausible fine human joint motion to complement the trajectory considering the estimated contacts. Compared to the state-of-the-art (SoA), STAG achieves a 1.8% and 16.2% overall improvement in pose and trajectory prediction, respectively, on the scene-aware GTA-IM dataset. A comprehensive ablation study confirms the advantages of staged modeling over end-to-end approaches. Furthermore, we establish the significance of a newly proposed temporal counter called the "time-to-go", which tells how long it is before reaching scene contact and endpoints. Notably, STAG showcases its ability to generalize to datasets lacking a scene and achieves a new state-of-the-art performance on CMU-Mocap, without leveraging any social cues. Our code is released at: https://github.com/L-Scofano/STAG


title: Wireless-Powered Communication Assisted by Two-Way Relay with Interference Alignment Underlaying Cognitive Radio Network

abstract: This study investigates the outage performance of an under-laying wireless-powered secondary system that reuses the primary users (PU) spectrum in a multiple-input multiple-output (MIMO) cognitive radio (CR) network. Each secondary user (SU) harvests energy and receives information simultaneously by applying power splitting (PS) protocol. The communication between SUs is aided by a two-way (TW) decode and forward (DF) relay. We formulate a problem to design the PS ratios at SUs, the power control factor at the secondary relay, and beamforming matrices at all nodes to minimize the secondary network's outage probability. To address this problem, we propose a two-step solution. The first step establishes closedform expressions for the PS ratios at each SU and secondary relay's power control factor. Furthermore, in the second step, interference alignment (IA) is used to design proper precoding and decoding matrices for managing the interference between secondary and primary networks. We choose IA matrices based on the minimum mean square error (MMSE) iterative algorithm. The simulation results demonstrate a significant decrease in the outage probability for the proposed scheme compared to the benchmark schemes, with an average reduction of more than two orders of magnitude achieved.


title: Enhancing Large Language Model Induced Task-Oriented Dialogue Systems Through Look-Forward Motivated Goals

abstract: Recently, the development of large language models (LLMs) has been significantly enhanced the question answering and dialogue generation, and makes them become increasingly popular in current practical scenarios. While unlike the general dialogue system which emphasizes the semantic performance, the task-oriented dialogue (ToD) systems aim to achieve the dialogue goal efficiently and successfully in multiple turns. Unfortunately, existing LLM-induced ToD systems lack the direct reward toward the final goal and do not take account of the dialogue proactivity that can strengthen the dialogue efficiency. To fill these gaps, we introduce the ProToD (Proactively Goal-Driven LLM-Induced ToD) approach, which anticipates the future dialogue actions and incorporates the goal-oriented reward signal to enhance ToD systems. Additionally, we present a novel evaluation method that assesses ToD systems based on goal-driven dialogue simulations. This method allows us to gauge user satisfaction, system efficiency and successful rate while overcoming the limitations of current Information and Success metrics. Empirical experiments conducted on the MultiWoZ 2.1 dataset demonstrate that our model can achieve superior performance using only 10% of the data compared to previous end-to-end fully supervised models. This improvement is accompanied by enhanced user satisfaction and efficiency.


title: Active shape control by plants in dynamic environments

abstract: Plants are a paradigm for active shape control in response to stimuli. For instance, it is well-known that a tilted plant will eventually straighten vertically, demonstrating the influence of both an external stimulus, gravity, and an internal stimulus, proprioception. These effects can be modulated when a potted plant is additionally rotated along the plant's axis, as in a rotating clinostat, leading to intricate shapes. We use a morphoelastic model for the response of growing plants to study the joint effect of both stimuli at all rotation speeds. In the absence of rotation, we identify a universal planar shape towards which all shoots eventually converge. With rotation, we demonstrate the existence of a stable family of three-dimensional dynamic equilibria where the plant axis is fixed in space. Further, the effect of axial growth is to induce steady behaviors, such as solitary waves. Overall, this study offers new insight into the complex out-of-equilibrium dynamics of a plant in three dimensions and further establishes that internal stimuli in active materials are key for robust shape control.


title: Phase transitions in one-dimensional Riesz gases with long-range interaction

abstract: We provide numerical evidence for the existence of phase transitions with respect to the temperature in the one-dimensional Riesz gases with non-singular pair interaction, that is particles on the line interacting via the potential $-|r|^{-s}$, where $s \in (-1, 0)$. Our numerics hint for the existence of two distinct phase transitions whose critical temperatures depend on $s$, namely a first transition which separates between a fluid and a quasisolid phase reminiscent of the Berezinski-Kosterlitz-Thouless (BKT) transition, and a second transition below which freezing occurs and the system is in a solid phase. We determine the phase diagram with respect to $s$ and the temperature $T$, which we find to be consistent with the known (or expected) results on the 1D Coulomb gas ($s = -1$), known to be a solid at all temperature, and the Dyson log--gas ($s = 0$) which exhibits a BKT transition at $T = 1/2$ and which is believed to be a fluid at all positive temperature.


title: Cross-Lingual Knowledge Editing in Large Language Models

abstract: Knowledge editing aims to change language models' performance on several special cases (i.e., editing scope) by infusing the corresponding expected knowledge into them. With the recent advancements in large language models (LLMs), knowledge editing has been shown as a promising technique to adapt LLMs to new knowledge without retraining from scratch. However, most of the previous studies neglect the multi-lingual nature of some main-stream LLMs (e.g., LLaMA, ChatGPT and GPT-4), and typically focus on monolingual scenarios, where LLMs are edited and evaluated in the same language. As a result, it is still unknown the effect of source language editing on a different target language. In this paper, we aim to figure out this cross-lingual effect in knowledge editing. Specifically, we first collect a large-scale cross-lingual synthetic dataset by translating ZsRE from English to Chinese. Then, we conduct English editing on various knowledge editing methods covering different paradigms, and evaluate their performance in Chinese, and vice versa. To give deeper analyses of the cross-lingual effect, the evaluation includes four aspects, i.e., reliability, generality, locality and portability. Furthermore, we analyze the inconsistent behaviors of the edited models and discuss their specific challenges. Data and codes are available at https://github.com/krystalan/Bi_ZsRE


title: Robust Backdoor Attacks on Object Detection in Real World

abstract: Deep learning models are widely deployed in many applications, such as object detection in various security fields. However, these models are vulnerable to backdoor attacks. Most backdoor attacks were intensively studied on classified models, but little on object detection. Previous works mainly focused on the backdoor attack in the digital world, but neglect the real world. Especially, the backdoor attack's effect in the real world will be easily influenced by physical factors like distance and illumination. In this paper, we proposed a variable-size backdoor trigger to adapt to the different sizes of attacked objects, overcoming the disturbance caused by the distance between the viewing point and attacked object. In addition, we proposed a backdoor training named malicious adversarial training, enabling the backdoor object detector to learn the feature of the trigger with physical noise. The experiment results show this robust backdoor attack (RBA) could enhance the attack success rate in the real world.


title: Recent advances in cosmological singularities

abstract: The discovery of universe's late-time acceleration and dark energy has overseen a great deal of research into cosmological singularities and in this brief review, we discuss all the prominent developments in this field for the best part of the last 2 decades. We discuss the fundamentals of space-time singularities after which we discuss about all the different forms of cosmological singularities which have been discovered in recent times in detail. We then talk about methods and techniques to avoid or moderate these singularities in various theories and discuss how these singularities can occur in non-conventional cosmologies too. We then discuss a useful dynamical systems approach to deal with these singularities and finish up with some outlooks for the field. We hope that this work serves as a good resource to anyone who wants to update themselves with the developments in this very exciting area.


title: IntelliBeeHive: An Automated Honey Bee, Pollen, and Varroa Destructor Monitoring System

abstract: Utilizing computer vision and the latest technological advancements, in this study, we developed a honey bee monitoring system that aims to enhance our understanding of Colony Collapse Disorder, honey bee behavior, population decline, and overall hive health. The system is positioned at the hive entrance providing real-time data, enabling beekeepers to closely monitor the hive's activity and health through an account-based website. Using machine learning, our monitoring system can accurately track honey bees, monitor pollen-gathering activity, and detect Varroa mites, all without causing any disruption to the honey bees. Moreover, we have ensured that the development of this monitoring system utilizes cost-effective technology, making it accessible to apiaries of various scales, including hobbyists, commercial beekeeping businesses, and researchers. The inference models used to detect honey bees, pollen, and mites are based on the YOLOv7-tiny architecture trained with our own data. The F1-score for honey bee model recognition is 0.95 and the precision and recall value is 0.981. For our pollen and mite object detection model F1-score is 0.95 and the precision and recall value is 0.821 for pollen and 0.996 for "mite". The overall performance of our IntelliBeeHive system demonstrates its effectiveness in monitoring the honey bee's activity, achieving an accuracy of 96.28 % in tracking and our pollen model achieved a F1-score of 0.831.


title: Multiwavelength study of extreme variability in LEDA 1154204: A changing-look event in a type 1.9 Seyfert

abstract: Context. Multiwavelength studies of transients in actively accreting supermassive black holes have revealed that large-amplitude variability is frequently linked to significant changes in the optical spectra -- a phenomenon referred to as changing-look AGN (CLAGN). Aim. In 2020, the Zwicky Transient Facility detected a transient flaring event in the type-1.9 AGN 6dFGS~gJ042838.8-000040, wherein a sharp increase in magnitude of $\sim$0.55 and $\sim$0.3 in the $g$- and $r$-bands, respectively, occurred over $\sim$40 days. Spectrum Roentgen Gamma (SRG)/eROSITA also observed the object in X-rays as part of its all-sky survey, but only after the flare had started decaying. Methods. We performed a three-year, multiwavelength follow-up campaign of the source to track its spectral and temporal characteristics. This campaign included multiple ground-based facilities for optical spectroscopic monitoring and space-based observatories including \textit{XMM-Newton} and \textit{Swift} for X-ray and UV observations. Results. An optical spectrum taken immediately after the peak revealed a changing-look event wherein the source had transitioned from type 1.9 to 1, with the appearance of a double-peaked broad H$\beta$ line and a blue continuum, both absent in an archival spectrum from 2005. The X-ray emission exhibits dramatic flux variation: a factor of $\sim$17, but with no spectral evolution, as the power-law photon index remained $\sim$1.9. There is no evidence of a soft X-ray excess. Overall the object exhibits no apparent signatures of a tidal disruption event. Conclusions. The transient event was likely triggered by a disk instability in a pre-existing accretion flow, culminating in the observed multi-wavelength variability and CLAGN event.


title: ExBluRF: Efficient Radiance Fields for Extreme Motion Blurred Images

abstract: We present ExBluRF, a novel view synthesis method for extreme motion blurred images based on efficient radiance fields optimization. Our approach consists of two main components: 6-DOF camera trajectory-based motion blur formulation and voxel-based radiance fields. From extremely blurred images, we optimize the sharp radiance fields by jointly estimating the camera trajectories that generate the blurry images. In training, multiple rays along the camera trajectory are accumulated to reconstruct single blurry color, which is equivalent to the physical motion blur operation. We minimize the photo-consistency loss on blurred image space and obtain the sharp radiance fields with camera trajectories that explain the blur of all images. The joint optimization on the blurred image space demands painfully increasing computation and resources proportional to the blur size. Our method solves this problem by replacing the MLP-based framework to low-dimensional 6-DOF camera poses and voxel-based radiance fields. Compared with the existing works, our approach restores much sharper 3D scenes from challenging motion blurred views with the order of 10 times less training time and GPU memory consumption.


title: Monolingual or Multilingual Instruction Tuning: Which Makes a Better Alpaca

abstract: Foundational large language models (LLMs) can be instruction-tuned to perform open-domain question answering, facilitating applications like chat assistants. While such efforts are often carried out in a single language, we empirically analyze cost-efficient strategies for multilingual scenarios. Our study employs the Alpaca dataset and machine translations of it to form multilingual data, which is then used to tune LLMs through either low-rank adaptation or full-parameter training. Under a controlled computation budget, comparisons show that multilingual tuning is on par or better than tuning a model for each language. Furthermore, multilingual tuning with downsampled data can be as powerful and more robust. Our findings serve as a guide for expanding language support through instruction tuning.


title: Non-centrosymmetric, transverse structural modulation in SrAl4, and elucidation of its origin in the BaAl4 family of compounds

abstract: At ambient conditions SrAl4 adopts the BaAl4 structure type with space group I4/mmm. It undergoes a charge-density-wave (CDW) transition at TCDW = 243 K, followed by a structural transition at TS = 87 K. Temperature-dependent single-crystal X-ray diffraction (SXRD) leads to the observation of incommensurate superlattice reflections at q = \sigma c* with \sigma = 0.1116 at 200 K. The CDW has orthorhombic symmetry with the acentric superspace group F222(00sigma)00s, where F222 is a subgroup of Fmmm as well as of I4/mmm. Atomic displacements mainly represent a transverse wave, with displacements that are 90 deg out of phase between the two diagonal directions of the I-centered unit cell, resulting in a helical wave. Small longitudinal displacements are provided by the second harmonic modulation. The orthorhombic phase realized in SrAl4 is similar to that found in EuAl4. Electronic structure calculations and phonon calculations by density functional theory (DFT) have failed to reveal the mechanism of CDW formation. However, DFT reveals that Al atoms dominate the density of states near the Fermi level, thus, corroborating the SXRD measurements. SrAl4 remains incommensurately modulated at the structural transition, where the symmetry lowers from orthorhombic to b-unique monoclinic. We have identified a simple criterion, that correlates the presence of a phase transition with the interatomic distances. Only those compounds XAl4-xGax(X = Ba, Eu, Sr, Ca; 0 < x <4) undergo phase transitions, for which the ratio c/a falls within the narrow range 2.51 < c/a < 2.54.


title: ODSum: New Benchmarks for Open Domain Multi-Document Summarization

abstract: Open-domain Multi-Document Summarization (ODMDS) is a critical tool for condensing vast arrays of documents into coherent, concise summaries. With a more inter-related document set, there does not necessarily exist a correct answer for the retrieval, making it hard to measure the retrieving performance. We propose a rule-based method to process query-based document summarization datasets into ODMDS datasets. Based on this method, we introduce a novel dataset, ODSum, a sophisticated case with its document index interdependent and often interrelated. We tackle ODMDS with the \textit{retrieve-then-summarize} method, and the performance of a list of retrievers and summarizers is investigated. Through extensive experiments, we identify variances in evaluation metrics and provide insights into their reliability. We also found that LLMs suffer great performance loss from retrieving errors. We further experimented methods to improve the performance as well as investigate their robustness against imperfect retrieval. We will release our data and code at https://github.com/yale-nlp/ODSum.


title: UNIDEAL: Curriculum Knowledge Distillation Federated Learning

abstract: Federated Learning (FL) has emerged as a promising approach to enable collaborative learning among multiple clients while preserving data privacy. However, cross-domain FL tasks, where clients possess data from different domains or distributions, remain a challenging problem due to the inherent heterogeneity. In this paper, we present UNIDEAL, a novel FL algorithm specifically designed to tackle the challenges of cross-domain scenarios and heterogeneous model architectures. The proposed method introduces Adjustable Teacher-Student Mutual Evaluation Curriculum Learning, which significantly enhances the effectiveness of knowledge distillation in FL settings. We conduct extensive experiments on various datasets, comparing UNIDEAL with state-of-the-art baselines. Our results demonstrate that UNIDEAL achieves superior performance in terms of both model accuracy and communication efficiency. Additionally, we provide a convergence analysis of the algorithm, showing a convergence rate of O(1/T) under non-convex conditions.


title: Dynamic Separation Logic

abstract: This paper introduces a dynamic logic extension of separation logic. The assertion language of separation logic is extended with modalities for the five types of the basic instructions of separation logic: simple assignment, look-up, mutation, allocation, and de-allocation. The main novelty of the resulting dynamic logic is that it allows to combine different approaches to resolving these modalities. One such approach is based on the standard weakest precondition calculus of separation logic. The other approach introduced in this paper provides a novel alternative formalization in the proposed dynamic logic extension of separation logic. The soundness and completeness of this axiomatization has been formalized in the Coq theorem prover.


title: Struc-Bench: Are Large Language Models Really Good at Generating Complex Structured Data?

abstract: Despite the remarkable capabilities of Large Language Models (LLMs) like GPT-4, producing complex, structured tabular data remains challenging. Our study assesses LLMs' proficiency in structuring tables and introduces a novel fine-tuning method, cognizant of data structures, to bolster their performance. We unveil Struc-Bench, a comprehensive benchmark featuring prominent LLMs (GPT-NeoX-20B, GPT-3.5, GPT-4, and Vicuna), which spans text tables, HTML, and LaTeX formats. Our proposed FormatCoT aids in crafting format-specific instructions from the intended outputs to populate this benchmark. Addressing the gap in task-centered evaluation, we propose two innovative metrics, P-Score (Prompting Score) and H-Score (Heuristical Score), to more accurately gauge LLM performance. Our experiments show that applying our structure-aware fine-tuning to LLaMA-7B leads to substantial performance gains, outshining its LLM counterparts across most measures. In-depth error analysis and creating an ability map across six dimensions -- coverage, formatting, reasoning, comprehension, pragmatics, and hallucination -- highlight areas for future enhancements and suggest forthcoming research trajectories. Our code and models can be found at https://github.com/gersteinlab/Struc-Bench.


title: Tightening Classification Boundaries in Open Set Domain Adaptation through Unknown Exploitation

abstract: Convolutional Neural Networks (CNNs) have brought revolutionary advances to many research areas due to their capacity of learning from raw data. However, when those methods are applied to non-controllable environments, many different factors can degrade the model's expected performance, such as unlabeled datasets with different levels of domain shift and category shift. Particularly, when both issues occur at the same time, we tackle this challenging setup as Open Set Domain Adaptation (OSDA) problem. In general, existing OSDA approaches focus their efforts only on aligning known classes or, if they already extract possible negative instances, use them as a new category learned with supervision during the course of training. We propose a novel way to improve OSDA approaches by extracting a high-confidence set of unknown instances and using it as a hard constraint to tighten the classification boundaries of OSDA methods. Especially, we adopt a new loss constraint evaluated in three different means, (1) directly with the pristine negative instances; (2) with randomly transformed negatives using data augmentation techniques; and (3) with synthetically generated negatives containing adversarial features. We assessed all approaches in an extensive set of experiments based on OVANet, where we could observe consistent improvements for two public benchmarks, the Office-31 and Office-Home datasets, yielding absolute gains of up to 1.3% for both Accuracy and H-Score on Office-31 and 5.8% for Accuracy and 4.7% for H-Score on Office-Home.


title: Multiagent Reinforcement Learning with an Attention Mechanism for Improving Energy Efficiency in LoRa Networks

abstract: Long Range (LoRa) wireless technology, characterized by low power consumption and a long communication range, is regarded as one of the enabling technologies for the Industrial Internet of Things (IIoT). However, as the network scale increases, the energy efficiency (EE) of LoRa networks decreases sharply due to severe packet collisions. To address this issue, it is essential to appropriately assign transmission parameters such as the spreading factor and transmission power for each end device (ED). However, due to the sporadic traffic and low duty cycle of LoRa networks, evaluating the system EE performance under different parameter settings is time-consuming. Therefore, we first formulate an analytical model to calculate the system EE. On this basis, we propose a transmission parameter allocation algorithm based on multiagent reinforcement learning (MALoRa) with the aim of maximizing the system EE of LoRa networks. Notably, MALoRa employs an attention mechanism to guide each ED to better learn how much ''attention'' should be given to the parameter assignments for relevant EDs when seeking to improve the system EE. Simulation results demonstrate that MALoRa significantly improves the system EE compared with baseline algorithms with an acceptable degradation in packet delivery rate (PDR).


title: FF-LOGO: Cross-Modality Point Cloud Registration with Feature Filtering and Local to Global Optimization

abstract: Cross-modality point cloud registration is confronted with significant challenges due to inherent differences in modalities between different sensors. We propose a cross-modality point cloud registration framework FF-LOGO: a cross-modality point cloud registration method with feature filtering and local-global optimization. The cross-modality feature correlation filtering module extracts geometric transformation-invariant features from cross-modality point clouds and achieves point selection by feature matching. We also introduce a cross-modality optimization process, including a local adaptive key region aggregation module and a global modality consistency fusion optimization module. Experimental results demonstrate that our two-stage optimization significantly improves the registration accuracy of the feature association and selection module. Our method achieves a substantial increase in recall rate compared to the current state-of-the-art methods on the 3DCSR dataset, improving from 40.59% to 75.74%. Our code will be available at https://github.com/wangmohan17/FFLOGO.


title: The Impact of Recommendation Systems on Opinion Dynamics: Microscopic versus Macroscopic Effects

abstract: Recommendation systems are widely used in web services, such as social networks and e-commerce platforms, to serve personalized content to the users and, thus, enhance their experience. While personalization assists users in navigating through the available options, there have been growing concerns regarding its repercussions on the users and their opinions. Examples of negative impacts include the emergence of filter bubbles and the amplification of users' confirmation bias, which can cause opinion polarization and radicalization. In this paper, we study the impact of recommendation systems on users, both from a microscopic (i.e., at the level of individual users) and a macroscopic (i.e., at the level of a homogenous population) perspective. Specifically, we build on recent work on the interactions between opinion dynamics and recommendation systems to propose a model for this closed loop, which we then study both analytically and numerically. Among others, our analysis reveals that shifts in the opinions of individual users do not always align with shifts in the opinion distribution of the population. In particular, even in settings where the opinion distribution appears unaltered (e.g., measured via surveys across the population), the opinion of individual users might be significantly distorted by the recommendation system.


title: Sorted LLaMA: Unlocking the Potential of Intermediate Layers of Large Language Models for Dynamic Inference

abstract: Large language models (LLMs) have revolutionized natural language processing (NLP) by excelling at understanding and generating human-like text. However, their widespread deployment can be prohibitively expensive. SortedNet is a recent training technique for enabling dynamic inference by leveraging the modularity in networks and sorting sub-models based on computation/accuracy in a nested manner. We extend SortedNet to generative NLP tasks, making large language models dynamic without any Pre-Training and by only replacing Standard Fine-Tuning (SFT) with Sorted Fine-Tuning (SoFT). Our approach boosts model efficiency, eliminating the need for multiple models for various scenarios during inference. We show that this approach can unlock the power of intermediate layers of transformers in generating the target output. Our sub-models remain integral components of the original model, minimizing storage requirements and transition costs between different computational/latency budgets. The efficacy of our proposed method was demonstrated by applying it to tune LLaMA 2 13B on the Stanford Alpaca dataset for instruction following and TriviaQA for closed-book question answering. Our results show the superior performance of sub-models in comparison to Standard Fine-Tuning and SFT+ICT (Early-Exit), all achieved with efficient tuning and without additional memory usage during inference.