title: EncodeNet: A Framework for Boosting DNN Accuracy with Entropy-driven Generalized Converting Autoencoder

abstract: Image classification is a fundamental task in computer vision, and the quest to enhance DNN accuracy without inflating model size or latency remains a pressing concern. We make a couple of advances in this regard, leading to a novel EncodeNet design and training framework. The first advancement involves Converting Autoencoders, a novel approach that transforms images into an easy-to-classify image of its class. Our prior work that applied the Converting Autoencoder and a simple classifier in tandem achieved moderate accuracy over simple datasets, such as MNIST and FMNIST. However, on more complex datasets like CIFAR-10, the Converting Autoencoder has a large reconstruction loss, making it unsuitable for enhancing DNN accuracy. To address these limitations, we generalize the design of Converting Autoencoders by leveraging a larger class of DNNs, those with architectures comprising feature extraction layers followed by classification layers. We incorporate a generalized algorithmic design of the Converting Autoencoder and intraclass clustering to identify representative images, leading to optimized image feature learning. Next, we demonstrate the effectiveness of our EncodeNet design and training framework, improving the accuracy of well-trained baseline DNNs while maintaining the overall model size. EncodeNet's building blocks comprise the trained encoder from our generalized Converting Autoencoders transferring knowledge to a lightweight classifier network - also extracted from the baseline DNN. Our experimental results demonstrate that EncodeNet improves the accuracy of VGG16 from 92.64% to 94.05% on CIFAR-10 and RestNet20 from 74.56% to 76.04% on CIFAR-100. It outperforms state-of-the-art techniques that rely on knowledge distillation and attention mechanisms, delivering higher accuracy for models of comparable size.


title: Exact CMB B-mode power spectrum from anisotropic cosmic birefringence

abstract: We calculate the cosmic microwave background (CMB) $B$-mode power spectrum resulting from anisotropic cosmic birefringence, without relying on the thin approximation of the last scattering surface. Specifically, we consider the influence of anisotropic cosmic birefringence arising from massless axion-like particles. Comparing our results to those obtained using the thin approximation, we observe a suppression in the amplitude of the $B$-mode power spectrum by approximately an order of magnitude at large angular scales ($\ell \lesssim 10$) and by a factor of two at small angular scales ($\ell \gtrsim 100$) when not employing the thin approximation. We also constrain the amplitude of the angular power spectrum of the scale-invariant anisotropic cosmic birefringence using the SPTpol $B$-mode power spectrum. We find that the amplitude is constrained as $A_{\rm CB}\times10^4=1.03^{+0.91}_{-0.97}\,(2\,\sigma)$. The numerical code is publicly available at https://github.com/toshiyan/biref-aniso-bb/tree/main.


title: Bounds to the mean curvature of leaves of CMC foliations

abstract: For a foliation by CMC hypersurfaces on a complete Riemannian manifold $M^{n+1}$ with sectional curvature bounded from below by $-nK_0\leq 0$ and such that the mean curvature $H$ of the leaves of the foliation satisfies $|H|\geq \sqrt{K_0}$, under certain additional hypotheses, for instance, if $M$ is a compact (without boundary) or if ${\rm div} (\nabla_N N)=0$ where the gradient of the function ${\rm div} (N)$ is non zero, then we prove that $|H|\equiv \sqrt{K_0}$, where $N$ is a unit vector field orthogonal to the foliation. Moreover, in the the case that $M$ is compact, we prove also that all the leaves are totally umbilical. This gives, in particular, a generalization for the result proved by Barbosa, Kenmotsu and Oshikiri (1991), where was proved the above result in the case $K_0=0$ and $M$ compact. Under the same additional hypotheses as above, we obtain that for a foliation by CMC hypersurfaces on a complete Riemannian manifold $M$ with Ricci curvature bounded from below by $-nK_0\leq 0$, the mean curvature $H$ of the leaves of the foliation satisfies $|H|\leq \sqrt{K_0}$. This gives a positive partial answer to a conjecture due to Meeks III, P\'erez and Ros. We also provide some partial answers to several other problems.


title: A route to quantum computing through the theory of quantum graphs

abstract: Based on our previous works, and in order to relate them with the theory of quantum graphs and the quantum computing principles, we once again try to introduce some newly developed technical structures just by relying on our toy example, the coordinate ring of $n\times n$ quantum matrix algebra $M_q(n)$, and the associated directed locally finite graphs $\mathcal{G}(\Pi_n)$, and the Cuntz-Krieger $C^*$-graph algebras. Meaningly, we introduce a $(4i-6)$-qubit quantum system by using the Cuntz-Krieger $\mathcal{G}(\Pi_i)$-families associated to the $4i-6$ distinct Hamiltonian paths of $\mathcal{G}(\Pi_i)$, for $i\in\{2,\cdots,n\}$. We also will present a proof of a claim raised in our previous paper concerning the graph $C^*$-algebra structure and the associated Cuntz-Krieger $\mathcal{G}(\Pi_n)$-families.


title: Constant energy families of harmonic maps

abstract: For a negatively curved manifold $M$ and a continuous map $\psi:\Sigma\to M$ from a closed surface $\Sigma$, we study complex submanifolds of Teichm\"uller space $\mathcal{S}\subset\mathcal{T}(\Sigma)$ such that the harmonic maps $\{h_X:X\to M\text{ for }X\in\mathcal{S}\}$ in the homotopy class of $\psi$ all have equal energy. When $M$ is real analytic with negative Hermitian sectional curvature, we show that for any such $\mathcal{S}$, there exists a closed Riemann surface $Y$, such that any $h_X$ for $X\in\mathcal{S}$ factors as a holomorphic map $\phi_X:X\to Y$ followed by a fixed harmonic map $h:Y\to M$. This answers a question posed by both Toledo and Gromov. As a first application, we show a factorization result for harmonic maps from normal projective varieties to $M$. As a second application, we study homomorphisms from finite index subgroups of mapping class groups to $\pi_1(M)$.


title: Waiting time statistics for a double quantum dot coupled with an optical cavity

abstract: A double quantum dot coupled to an optical cavity is a prototypical example of a non-trivial open quantum system. Recent experimental and theoretical studies show that this system is a candidate for single-photon detection in the microwave domain. This motivates studies that go beyond just the average current, and also take into account the full counting statistics of photon and electron detections. With this in mind, here we provide a detailed analysis of the waiting time statistics of this system within the quantum jump unravelling, which allows us to extract analytical expressions for the success and failure probabilities, as well as for the inter detection times. Furthermore, by comparing single and multi-photon scenarios, we infer a hierarchy of occurrence probabilities for the different events, highlighting the role of photon interference events in the detection probabilities. Our results therefore provide a direct illustration of how waiting time statistics can be used to optimize a timely and relevant metrological task.


title: Hopf algebras, Steinberg modules, and the unstable cohomology of $SL_n(\mathbb Z)$ and $GL_n(\mathbb Z)$

abstract: We prove that the direct sum of all homology groups of the integral general linear groups with Steinberg module coefficients form a commutative Hopf algebra, in particular a free graded commutative algebra. We use this to construct new infinite families of unstable cohomology classes of $SL_n(\mathbb Z)$.


title: Explainable Interfaces for Rapid Gaze-Based Interactions in Mixed Reality

abstract: Gaze-based interactions offer a potential way for users to naturally engage with mixed reality (XR) interfaces. Black-box machine learning models enabled higher accuracy for gaze-based interactions. However, due to the black-box nature of the model, users might not be able to understand and effectively adapt their gaze behaviour to achieve high quality interaction. We posit that explainable AI (XAI) techniques can facilitate understanding of and interaction with gaze-based model-driven system in XR. To study this, we built a real-time, multi-level XAI interface for gaze-based interaction using a deep learning model, and evaluated it during a visual search task in XR. A between-subjects study revealed that participants who interacted with XAI made more accurate selections compared to those who did not use the XAI system (i.e., F1 score increase of 10.8%). Additionally, participants who used the XAI system adapted their gaze behavior over time to make more effective selections. These findings suggest that XAI can potentially be used to assist users in more effective collaboration with model-driven interactions in XR.


title: Multi-channel Emotion Analysis for Consensus Reaching in Group Movie Recommendation Systems

abstract: Watching movies is one of the social activities typically done in groups. Emotion is the most vital factor that affects movie viewers' preferences. So, the emotional aspect of the movie needs to be determined and analyzed for further recommendations. It can be challenging to choose a movie that appeals to the emotions of a diverse group. Reaching an agreement for a group can be difficult due to the various genres and choices. This paper proposes a novel approach to group movie suggestions by examining emotions from three different channels: movie descriptions (text), soundtracks (audio), and posters (image). We employ the Jaccard similarity index to match each participant's emotional preferences to prospective movie choices, followed by a fuzzy inference technique to determine group consensus. We use a weighted integration process for the fusion of emotion scores from diverse data types. Then, group movie recommendation is based on prevailing emotions and viewers' best-loved movies. After determining the recommendations, the group's consensus level is calculated using a fuzzy inference system, taking participants' feedback as input. Participants (n=130) in the survey were provided with different emotion categories and asked to select the emotions best suited for particular movies (n=12). Comparison results between predicted and actual scores demonstrate the efficiency of using emotion detection for this problem (Jaccard similarity index = 0.76). We explored the relationship between induced emotions and movie popularity as an additional experiment, analyzing emotion distribution in 100 popular movies from the TMDB database. Such systems can potentially improve the accuracy of movie recommendation systems and achieve a high level of consensus among participants with diverse preferences.


title: Automated Text Mining of Experimental Methodologies from Biomedical Literature

abstract: Biomedical literature is a rapidly expanding field of science and technology. Classification of biomedical texts is an essential part of biomedicine research, especially in the field of biology. This work proposes the fine-tuned DistilBERT, a methodology-specific, pre-trained generative classification language model for mining biomedicine texts. The model has proven its effectiveness in linguistic understanding capabilities and has reduced the size of BERT models by 40\% but by 60\% faster. The main objective of this project is to improve the model and assess the performance of the model compared to the non-fine-tuned model. We used DistilBert as a support model and pre-trained on a corpus of 32,000 abstracts and complete text articles; our results were impressive and surpassed those of traditional literature classification methods by using RNN or LSTM. Our aim is to integrate this highly specialised and specific model into different research industries.


title: Mathematical and numerical analysis for PDE systems modeling intravascular drug release from arterial stents and transport in arterial tissue

abstract: This paper is concerned with the PDE and numerical analysis of a modified one-dimensional intravascular stent model originally proposed in [4]. It is proved that the modified model has a unique weak solution using the Galerkin method combined with a compactness argument. A semi-discrete finite element method and a fully discrete scheme using the Euler time-stepping are formulated for the PDE model. Optimal order error estimates in the energy norm are proved for both schemes. Numerical results are presented along with comparisons between different decoupling strategies and time-stepping schemes. Lastly, extensions of the model and its PDE and numerical analysis results to the two-dimensional case are also briefly discussed.


title: Evaluating Retrieval Quality in Retrieval-Augmented Generation

abstract: Evaluating retrieval-augmented generation (RAG) presents challenges, particularly for retrieval models within these systems. Traditional end-to-end evaluation methods are computationally expensive. Furthermore, evaluation of the retrieval model's performance based on query-document relevance labels shows a small correlation with the RAG system's downstream performance. We propose a novel evaluation approach, eRAG, where each document in the retrieval list is individually utilized by the large language model within the RAG system. The output generated for each document is then evaluated based on the downstream task ground truth labels. In this manner, the downstream performance for each document serves as its relevance label. We employ various downstream task metrics to obtain document-level annotations and aggregate them using set-based or ranking metrics. Extensive experiments on a wide range of datasets demonstrate that eRAG achieves a higher correlation with downstream RAG performance compared to baseline methods, with improvements in Kendall's $\tau$ correlation ranging from 0.168 to 0.494. Additionally, eRAG offers significant computational advantages, improving runtime and consuming up to 50 times less GPU memory than end-to-end evaluation.


title: The Characterization of Abstract Truth and its Factorization

abstract: Human knowledge is made up of the conceptual structures of many communities of interest. In order to establish coherence in human knowledge representation, it is important to enable communication between the conceptual structures of different communities The conceptual structures of any particular community is representable in an ontology. Such a ontology provides a formal linguistic standard for that community. However, a standard community ontology is established for various purposes, and makes choices that force a given interpretation, while excluding others that may be equally valid for other purposes. Hence, a given representation is relative to the purpose for that representation. Due to this relativity of representation, in the larger scope of all human knowledge it is more important to standardize methods and frameworks for relating ontologies than to standardize any particular choice of ontology. The standardization of methods and frameworks is called the semantic integration of ontologies.


title: Spin Theory Based on the Extended Least Action Principle and Information Metrics: Quantization, Entanglement, and Bell Test With Time Delay

abstract: A theory of electron spin is developed here based on the extended least action principle and assumptions of intrinsic angular momentum of an electron with random orientations. By incorporating appropriate relative entropy for the random orientations of intrinsic angular momentum in the extended least action principle, the theory recovers the quantum formulation of electron spin. The two-level quantization of spin measurement is a natural mathematical consequence instead of a postulate. The formulation of measurement probability when a second Stern-Gerlach apparatus is rotated relative to the first Stern-Gerlach apparatus, and the Schr\"{o}dinger-Pauli equation, are also derived successfully. Furthermore, we provide an intuitive physical model and formulation to explain the entanglement phenomenon between two electron spins. In this model, spin entanglement is the consequence of correlation between the random orientations of the intrinsic angular momenta of the two electrons. Since the orientation is an intrinsic local property of electron, the correlation of orientations can be preserved even when the two electrons are remotely separated. Such a correlation can be manifested without causal effect. Owing to this orientation correlation, the Bell-CHSH inequality is shown to be violated in a Bell test. The standard quantum theory of electron spin can be considered as an ideal approximation of the present theory when certain conditions are taken to the limits. A potential experiment is proposed to test the difference between the present theory and the standard quantum theory. In a typical Bell test that confirms the violation of Bell-CHSH inequality, the theory suggests that by adding a sufficiently large time delay before Bob's measurement, the Bell-CHSH inequality can become non-violated.


title: Iteratively Prompting Multimodal LLMs to Reproduce Natural and AI-Generated Images

abstract: With the digital imagery landscape rapidly evolving, image stocks and AI-generated image marketplaces have become central to visual media. Traditional stock images now exist alongside innovative platforms that trade in prompts for AI-generated visuals, driven by sophisticated APIs like DALL-E 3 and Midjourney. This paper studies the possibility of employing multi-modal models with enhanced visual understanding to mimic the outputs of these platforms, introducing an original attack strategy. Our method leverages fine-tuned CLIP models, a multi-label classifier, and the descriptive capabilities of GPT-4V to create prompts that generate images similar to those available in marketplaces and from premium stock image providers, yet at a markedly lower expense. In presenting this strategy, we aim to spotlight a new class of economic and security considerations within the realm of digital imagery. Our findings, supported by both automated metrics and human assessment, reveal that comparable visual content can be produced for a fraction of the prevailing market prices ($0.23 - $0.27 per image), emphasizing the need for awareness and strategic discussions about the integrity of digital media in an increasingly AI-integrated landscape. Our work also contributes to the field by assembling a dataset consisting of approximately 19 million prompt-image pairs generated by the popular Midjourney platform, which we plan to release publicly.


title: How to Inverting the Leverage Score Distribution?

abstract: Leverage score is a fundamental problem in machine learning and theoretical computer science. It has extensive applications in regression analysis, randomized algorithms, and neural network inversion. Despite leverage scores are widely used as a tool, in this paper, we study a novel problem, namely the inverting leverage score problem. We analyze to invert the leverage score distributions back to recover model parameters. Specifically, given a leverage score $\sigma \in \mathbb{R}^n$, the matrix $A \in \mathbb{R}^{n \times d}$, and the vector $b \in \mathbb{R}^n$, we analyze the non-convex optimization problem of finding $x \in \mathbb{R}^d$ to minimize $\| \mathrm{diag}( \sigma ) - I_n \circ (A(x) (A(x)^\top A(x) )^{-1} A(x)^\top ) \|_F$, where $A(x):= S(x)^{-1} A \in \mathbb{R}^{n \times d} $, $S(x) := \mathrm{diag}(s(x)) \in \mathbb{R}^{n \times n}$ and $s(x) : = Ax - b \in \mathbb{R}^n$. Our theoretical studies include computing the gradient and Hessian, demonstrating that the Hessian matrix is positive definite and Lipschitz, and constructing first-order and second-order algorithms to solve this regression problem. Our work combines iterative shrinking and the induction hypothesis to ensure global convergence rates for the Newton method, as well as the properties of Lipschitz and strong convexity to guarantee the performance of gradient descent. This important study on inverting statistical leverage opens up numerous new applications in interpretation, data recovery, and security.


title: Soar: Design and Deployment of A Smart Roadside Infrastructure System for Autonomous Driving

abstract: Recently,smart roadside infrastructure (SRI) has demonstrated the potential of achieving fully autonomous driving systems. To explore the potential of infrastructure-assisted autonomous driving, this paper presents the design and deployment of Soar, the first end-to-end SRI system specifically designed to support autonomous driving systems. Soar consists of both software and hardware components carefully designed to overcome various system and physical challenges. Soar can leverage the existing operational infrastructure like street lampposts for a lower barrier of adoption. Soar adopts a new communication architecture that comprises a bi-directional multi-hop I2I network and a downlink I2V broadcast service, which are designed based on off-the-shelf 802.11ac interfaces in an integrated manner. Soar also features a hierarchical DL task management framework to achieve desirable load balancing among nodes and enable them to collaborate efficiently to run multiple data-intensive autonomous driving applications. We deployed a total of 18 Soar nodes on existing lampposts on campus, which have been operational for over two years. Our real-world evaluation shows that Soar can support a diverse set of autonomous driving applications and achieve desirable real-time performance and high communication reliability. Our findings and experiences in this work offer key insights into the development and deployment of next-generation smart roadside infrastructure and autonomous driving systems.


title: Fourier transform on the locus of cyclic spectral curves in the Hitchin base

abstract: We compute the Fourier transform of some of the summands of the push-forward of the constant sheaf under the Hitchin map for $\mathrm{SL}_n$ restricted to the locus of cyclic spectral curves inside the Hitchin base (for $\mathrm{SL}_2$ all spectral curves are cyclic) and give an estimate on the support of the Fourier transforms of the other summands.


title: AnyPattern: Towards In-context Image Copy Detection

abstract: This paper explores in-context learning for image copy detection (ICD), i.e., prompting an ICD model to identify replicated images with new tampering patterns without the need for additional training. The prompts (or the contexts) are from a small set of image-replica pairs that reflect the new patterns and are used at inference time. Such in-context ICD has good realistic value, because it requires no fine-tuning and thus facilitates fast reaction against the emergence of unseen patterns. To accommodate the "seen $\rightarrow$ unseen" generalization scenario, we construct the first large-scale pattern dataset named AnyPattern, which has the largest number of tamper patterns ($90$ for training and $10$ for testing) among all the existing ones. We benchmark AnyPattern with popular ICD methods and reveal that existing methods barely generalize to novel patterns. We further propose a simple in-context ICD method named ImageStacker. ImageStacker learns to select the most representative image-replica pairs and employs them as the pattern prompts in a stacking manner (rather than the popular concatenation manner). Experimental results show (1) training with our large-scale dataset substantially benefits pattern generalization ($+26.66 \%$ $\mu AP$), (2) the proposed ImageStacker facilitates effective in-context ICD (another round of $+16.75 \%$ $\mu AP$), and (3) AnyPattern enables in-context ICD, i.e., without such a large-scale dataset, in-context learning does not emerge even with our ImageStacker. Beyond the ICD task, we also demonstrate how AnyPattern can benefit artists, i.e., the pattern retrieval method trained on AnyPattern can be generalized to identify style mimicry by text-to-image models. The project is publicly available at https://anypattern.github.io.


title: Anchor-aware Deep Metric Learning for Audio-visual Retrieval

abstract: Metric learning minimizes the gap between similar (positive) pairs of data points and increases the separation of dissimilar (negative) pairs, aiming at capturing the underlying data structure and enhancing the performance of tasks like audio-visual cross-modal retrieval (AV-CMR). Recent works employ sampling methods to select impactful data points from the embedding space during training. However, the model training fails to fully explore the space due to the scarcity of training data points, resulting in an incomplete representation of the overall positive and negative distributions. In this paper, we propose an innovative Anchor-aware Deep Metric Learning (AADML) method to address this challenge by uncovering the underlying correlations among existing data points, which enhances the quality of the shared embedding space. Specifically, our method establishes a correlation graph-based manifold structure by considering the dependencies between each sample as the anchor and its semantically similar samples. Through dynamic weighting of the correlations within this underlying manifold structure using an attention-driven mechanism, Anchor Awareness (AA) scores are obtained for each anchor. These AA scores serve as data proxies to compute relative distances in metric learning approaches. Extensive experiments conducted on two audio-visual benchmark datasets demonstrate the effectiveness of our proposed AADML method, significantly surpassing state-of-the-art models. Furthermore, we investigate the integration of AA proxies with various metric learning methods, further highlighting the efficacy of our approach.


title: On illposedness of the Hall and electron magnetohydrodynamic equations without resistivity on the whole space

abstract: It has been shown in our previous work that the incompressible and irresistive Hall- and electron-magnetohydrodynamic (MHD) equations are illposed on flat domains $M = \mathbb{R}^k \times \mathbb{T}^{3-k}$ for $0 \le k \le 2$. The data and solutions therein were assumed to be independent of one coordinate, which not only significantly simplifies the systems but also allows for a large class of steady states. In this work, we remove the assumption of independence and conclude strong illposedness for compactly supported data in $\mathbb{R}^3$. This is achieved by constructing degenerating wave packets for linearized systems around time-dependent axisymmetric magnetic fields. A few main additional ingredients are: a more systematic application of the generalized energy estimate, use of the Bogovski\v{i} operator, and a priori estimates for axisymmetric solutions to the Hall- and electron-MHD systems.


title: Universal Fingerprint Generation: Controllable Diffusion Model with Multimodal Conditions

abstract: The utilization of synthetic data for fingerprint recognition has garnered increased attention due to its potential to alleviate privacy concerns surrounding sensitive biometric data. However, current methods for generating fingerprints have limitations in creating impressions of the same finger with useful intra-class variations. To tackle this challenge, we present GenPrint, a framework to produce fingerprint images of various types while maintaining identity and offering humanly understandable control over different appearance factors such as fingerprint class, acquisition type, sensor device, and quality level. Unlike previous fingerprint generation approaches, GenPrint is not confined to replicating style characteristics from the training dataset alone: it enables the generation of novel styles from unseen devices without requiring additional fine-tuning. To accomplish these objectives, we developed GenPrint using latent diffusion models with multimodal conditions (text and image) for consistent generation of style and identity. Our experiments leverage a variety of publicly available datasets for training and evaluation. Results demonstrate the benefits of GenPrint in terms of identity preservation, explainable control, and universality of generated images. Importantly, the GenPrint-generated images yield comparable or even superior accuracy to models trained solely on real data and further enhances performance when augmenting the diversity of existing real fingerprint datasets.


title: Counterfactual Reasoning Using Predicted Latent Personality Dimensions for Optimizing Persuasion Outcome

abstract: Customizing persuasive conversations related to the outcome of interest for specific users achieves better persuasion results. However, existing persuasive conversation systems rely on persuasive strategies and encounter challenges in dynamically adjusting dialogues to suit the evolving states of individual users during interactions. This limitation restricts the system's ability to deliver flexible or dynamic conversations and achieve suboptimal persuasion outcomes. In this paper, we present a novel approach that tracks a user's latent personality dimensions (LPDs) during ongoing persuasion conversation and generates tailored counterfactual utterances based on these LPDs to optimize the overall persuasion outcome. In particular, our proposed method leverages a Bi-directional Generative Adversarial Network (BiCoGAN) in tandem with a Dialogue-based Personality Prediction Regression (DPPR) model to generate counterfactual data. This enables the system to formulate alternative persuasive utterances that are more suited to the user. Subsequently, we utilize the D3QN model to learn policies for optimized selection of system utterances on counterfactual data. Experimental results we obtained from using the PersuasionForGood dataset demonstrate the superiority of our approach over the existing method, BiCoGAN. The cumulative rewards and Q-values produced by our method surpass ground truth benchmarks, showcasing the efficacy of employing counterfactual reasoning and LPDs to optimize reinforcement learning policy in online interactions.


title: Lightweight Connective Detection Using Gradient Boosting

abstract: In this work, we introduce a lightweight discourse connective detection system. Employing gradient boosting trained on straightforward, low-complexity features, this proposed approach sidesteps the computational demands of the current approaches that rely on deep neural networks. Considering its simplicity, our approach achieves competitive results while offering significant gains in terms of time even on CPU. Furthermore, the stable performance across two unrelated languages suggests the robustness of our system in the multilingual scenario. The model is designed to support the annotation of discourse relations, particularly in scenarios with limited resources, while minimizing performance loss.


title: Effects of classical drivings on the power broadening of atomic lineshapes

abstract: In the framework of the Jaynes-Cummings model, we investigate how atomic lineshapes are affected by coherently driving the atom-field interaction. We pay particular attention to the two-level atom interaction with a thermal cavity field, when both are influenced by external classical fields. Adopting a density matrix formalism, we calculate the average atomic inversion and demonstrate how the corresponding lineshapes vary as a function of the average number of thermal photons, and the atom-field classical coupling. Furthermore, we compare these results with those obtained from the standard Jaynes-Cummings model and validate our findings through numerical calculations.


title: The limit of the operator norm for random matrices with a variance profile

abstract: In this work we study symmetric random matrices with variance profile satisfying certain conditions. We establish the convergence of the operator norm of these matrices to the largest element of the support of the limiting empirical spectral distribution. We prove that it is sufficient for the entries of the matrix to have finite only the $4$-th moment or the $4+\epsilon$ moment in order for the convergence to hold in probability or almost surely respectively. Our approach determines the behaviour of the operator norm for random symmetric or non-symmetric matrices whose variance profile is given by a step or a continuous function, random band matrices whose bandwidth is proportional to their dimension, random Gram matrices, triangular matrices and more.


title: A Cyclic Spectroscopy Scintillation Study of PSR B1937+21 I. Demonstration of Improved Scintillometry

abstract: We use cyclic spectroscopy to perform high frequency-resolution analyses of multi-hour baseband Arecibo observations of the millisecond pulsar PSR B1937+21. This technique allows for the examination of scintillation features in far greater detail than is otherwise possible under most pulsar timing array observing setups. We measure scintillation bandwidths and timescales in each of eight subbands across a 200 MHz observing band in each observation. Through these measurements we obtain intra-epoch estimates of the frequency scalings for scintillation bandwidth and timescale.Thanks to our high frequency resolution and the narrow scintles of this pulsar, we resolve scintillation arcs in the secondary spectra due to the increased Nyquist limit, which would not have been resolved at the same observing frequency with a traditional filterbank spectrum using NANOGrav's current time and frequency resolutions, and the frequency-dependent evolution of scintillation arc features within individual observations. We observe the dimming of prominent arc features at higher frequencies, possibly due to a combination of decreasing flux density and the frequency dependence of the plasma refractive index of the interstellar medium. We also find agreement with arc curvature frequency dependence predicted by Stinebring et al. (2001) in some epochs. Thanks to the frequency resolution improvement provided by cyclic spectroscopy, these results show strong promise for future such analyses with millisecond pulsars, particularly for pulsar timing arrays, where such techniques can allow for detailed studies of the interstellar medium in highly scattered pulsars without sacrificing the timing resolution that is crucial to their gravitational wave detection efforts.


title: On pseudo-Riemannian Ricci-parallel Lie groups which are not Einstein

abstract: In this paper, we mainly study left invariant pseudo-Riemannian Ricci-parallel metrics on connected Lie groups which are not Einstein. Following a result of Boubel and B\'{e}rard Bergery, there are two typical types of such metrics, which are characterized by the minimal polynomial of the Ricci operator. Namely, its form is either $(X-\alpha)(X-\bar{\alpha})$ (type I), where $\alpha\in \mathbb{C}\setminus \mathbb{R}$, or $X^{2}$ (type II). Firstly, we obtain a complete description of Ricci-parallel metrics of type I. In particular, such a Ricci-parallel metric is uniquely determined by an Einstein metric and an invariant symmetric parallel complex structure up to isometry and scaling. Then we study Ricci-parallel metric Lie algebras of type II by using double extension process. Surprisingly, we find that every double extension of a metric Abelian Lie algebra is Ricci-parallel and the converse holds for Lorentz Ricci-parallel metric nilpotent Lie algebras of type II. Moreover, we construct infinitely many new explicit examples of Ricci-parallel metric Lie algebras which are not Einstein.


title: Enforcing Conditional Independence for Fair Representation Learning and Causal Image Generation

abstract: Conditional independence (CI) constraints are critical for defining and evaluating fairness in machine learning, as well as for learning unconfounded or causal representations. Traditional methods for ensuring fairness either blindly learn invariant features with respect to a protected variable (e.g., race when classifying sex from face images) or enforce CI relative to the protected attribute only on the model output (e.g., the sex label). Neither of these methods are effective in enforcing CI in high-dimensional feature spaces. In this paper, we focus on a nascent approach characterizing the CI constraint in terms of two Jensen-Shannon divergence terms, and we extend it to high-dimensional feature spaces using a novel dynamic sampling strategy. In doing so, we introduce a new training paradigm that can be applied to any encoder architecture. We are able to enforce conditional independence of the diffusion autoencoder latent representation with respect to any protected attribute under the equalized odds constraint and show that this approach enables causal image generation with controllable latent spaces. Our experimental results demonstrate that our approach can achieve high accuracy on downstream tasks while upholding equality of odds.


title: Discovery of the Free Precession in the Magnetar SGR 1806$-$20 with the ASCA GIS

abstract: Four X-ray data sets of the Soft Gamma Repeater SGR 1806-20, taken with the Gas Imaging Spectrometer (GIS) onboad ASCA, were analyzed. Three of them were acquired over 1993 October 9-20, whereas the last one in 1995 October. Epoch-folding analysis of the 2.8-12 keV signals confirmed the $\sim 7.6$ s pulses in these data, which Kouveliotou et al. (1998) reported as one of the earliest pulse detections from this object. In the 1995 observation, 3-12 keV pulses were phase modulated with a period of $T =16.4 \pm 0.4$ ks, and an amplitude of $\sim 1$ s. This makes a fourth example of the behavior observed from magnetars. Like in the previous three sources, the pulse-phase modulation of SGR 1806-20 disappeared at $\lesssim 2.5$ keV, where the soft X-ray component dominates. In the 1993 data sets, this periodic modulation was reconfirmed, and successfully phase-connected coherently across the 11 d interval. As a result, the modulation period was refined to $T =16.435 \pm 0.024$ ks. The implied high stability of the phenomenon strengthens its interpretation in terms of free precession of the neutron star, which is deformed to an asphericity of $\sim 10^{-4}$, presumably by the stress of toroidal magnetic fields reaching $\sim 10^{16}$ G. Toroidal fields of this level can be common among magnetars.


title: Dynamics of Polar-Core Spin Vortices in Inhomogeneous Spin-1 Bose-Einstein Condensates

abstract: In the easy-plane phase, a ferromagnetic spin-1 Bose-Einstein condensate is magnetized in a plane transverse to the applied Zeeman field. This phase supports polar-core spin vortices (PCVs), which consist of phase windings of transverse magnetization. Here we show that spin-changing collisions cause a PCV to accelerate down density gradients in an inhomogeneous condensate. The dynamics is well-described by a simplified model adapted from scalar systems, which predicts the dependence of the dynamics on trap tightness and quadratic Zeeman energy. In a harmonic trap, a PCV accelerates radially to the condensate boundary, in stark contrast to the azimuthal motion of vortices in a scalar condensate. In a trap that has a local potential maximum at the centre, the PCV exhibits oscillations around the trap centre, which persist for a remarkably long time. The oscillations coincide with the emission and reabsorption of axial spin waves, which reflect off the condensate boundary.


title: Quantum Transport Simulation of Sub-1-nm Gate Length Monolayer MoS2 Transistors

abstract: Sub-1-nm gate length $MoS_2$ transistors have been experimentally fabricated, but their device performance limit remains elusive. Herein, we explore the performance limits of the sub-1-nm gate length monolayer (ML) $MoS_2$ transistors through ab initio quantum transport simulations. Our simulation results demonstrate that, through appropriate doping and dielectric engineering, the sub-1-nm devices can meet the requirement of extended 'ITRS'(International Technology Roadmap for Semiconductors) $L_g$=0.34 nm. Following device optimization, we achieve impressive maximum on-state current densities of 409 $\mu A / \mu m$ for n-type and 800 $\mu A / \mu m$ for p-type high-performance (HP) devices, while n-type and p-type low-power (LP) devices exhibit maximum on-state current densities of 75 $\mu A / \mu m$ and 187 $\mu A / \mu m$, respectively. We employed the Wentzel-Kramer-Brillouin (WKB) approximation to explain the physical mechanisms of underlap and spacer region optimization on transistor performance. The underlap and spacer regions primarily influence the transport properties of sub-1-nm transistors by respectively altering the width and body factor of the potential barriers. Compared to ML $MoS_2$ transistors with a 1 nm gate length, our sub-1-nm gate length HP and LP ML $MoS_2$ transistors exhibit lower energy-delay products. Hence the sub-1-nm gate length transistors have immense potential for driving the next generation of electronics.


title: The Fall of an Algorithm: Characterizing the Dynamics Toward Abandonment

abstract: As more algorithmic systems have come under scrutiny for their potential to inflict societal harms, an increasing number of organizations that hold power over harmful algorithms have chosen (or were required under the law) to abandon them. While social movements and calls to abandon harmful algorithms have emerged across application domains, little academic attention has been paid to studying abandonment as a means to mitigate algorithmic harms. In this paper, we take a first step towards conceptualizing "algorithm abandonment" as an organization's decision to stop designing, developing, or using an algorithmic system due to its (potential) harms. We conduct a thematic analysis of real-world cases of algorithm abandonment to characterize the dynamics leading to this outcome. Our analysis of 40 cases reveals that campaigns to abandon an algorithm follow a common process of six iterative phases: discovery, diagnosis, dissemination, dialogue, decision, and death, which we term the "6 D's of abandonment". In addition, we highlight key factors that facilitate (or prohibit) abandonment, which include characteristics of both the technical and social systems that the algorithm is embedded within. We discuss implications for several stakeholders, including proprietors and technologists who have the power to influence an algorithm's (dis)continued use, FAccT researchers, and policymakers.


title: A new family of counterexamples to the Zariski Cancellation Problem in positive characteristic

abstract: In this paper, over a field of positive characteristic we exhibit an infinite family of counter examples to the Zariski Cancellation Problem in higher dimensions ($\geqslant 3$) which are pairwise non-isomorphic and also non-isomorphic to the existing family of counter examples, demonstrated by Gupta in \cite{adv}.


title: Adaptive Heterogeneous Client Sampling for Federated Learning over Wireless Networks

abstract: Federated learning (FL) algorithms usually sample a fraction of clients in each round (partial participation) when the number of participants is large and the server's communication bandwidth is limited. Recent works on the convergence analysis of FL have focused on unbiased client sampling, e.g., sampling uniformly at random, which suffers from slow wall-clock time for convergence due to high degrees of system heterogeneity and statistical heterogeneity. This paper aims to design an adaptive client sampling algorithm for FL over wireless networks that tackles both system and statistical heterogeneity to minimize the wall-clock convergence time. We obtain a new tractable convergence bound for FL algorithms with arbitrary client sampling probability. Based on the bound, we analytically establish the relationship between the total learning time and sampling probability with an adaptive bandwidth allocation scheme, which results in a non-convex optimization problem. We design an efficient algorithm for learning the unknown parameters in the convergence bound and develop a low-complexity algorithm to approximately solve the non-convex problem. Our solution reveals the impact of system and statistical heterogeneity parameters on the optimal client sampling design. Moreover, our solution shows that as the number of sampled clients increases, the total convergence time first decreases and then increases because a larger sampling number reduces the number of rounds for convergence but results in a longer expected time per-round due to limited wireless bandwidth. Experimental results from both hardware prototype and simulation demonstrate that our proposed sampling scheme significantly reduces the convergence time compared to several baseline sampling schemes.


title: A remark on the B-model Comparison of Hodge structures

abstract: In this note we record a comparison theorem on the B-model variation of semi-infinite Hodge structures. This result is considered a folklore theorem by experts in the field. We only take this opportunity to write it down. Our motivation is to apply it in the study of B-model categorical enumerative invariants.


title: On the existence of ground states to Hartree-type equations in $\mathbb{R}^3$ with a delta potential

abstract: Consider the Hartree-type equation in $\mathbb{R}^3$ with a delta potential formally described by $$ i \partial_t \psi = - \Delta_x \psi + \alpha \delta_0 \psi - (I_\beta \ast |\psi|^p) |\psi|^{p - 2} \psi $$ where $\alpha \in \mathbb{R}$; $0 < \beta < 3$ and we want to solve for $\psi \colon \mathbb{R}^3 \times \mathbb{R} \to \mathbb{C}$. By means of a Poho\v{z}aev identity, we show that if $p = (3 + \beta) / 3$ and $\alpha \geq 0$, then the problem has no ground state at any mass $\mu > 0$. We also prove that if $$ \frac{3 + \beta}{3} < p < \min \left( \frac{5 + \beta}{3}, \frac{5 + 2 \beta}{4} \right), $$ which includes the physically-relevant case $p = \beta = 2$, then the problem admits a ground state at any mass $\mu > 0$.


title: FaceFolds: Meshed Radiance Manifolds for Efficient Volumetric Rendering of Dynamic Faces

abstract: 3D rendering of dynamic face captures is a challenging problem, and it demands improvements on several fronts$\unicode{x2014}$photorealism, efficiency, compatibility, and configurability. We present a novel representation that enables high-quality volumetric rendering of an actor's dynamic facial performances with minimal compute and memory footprint. It runs natively on commodity graphics soft- and hardware, and allows for a graceful trade-off between quality and efficiency. Our method utilizes recent advances in neural rendering, particularly learning discrete radiance manifolds to sparsely sample the scene to model volumetric effects. We achieve efficient modeling by learning a single set of manifolds for the entire dynamic sequence, while implicitly modeling appearance changes as temporal canonical texture. We export a single layered mesh and view-independent RGBA texture video that is compatible with legacy graphics renderers without additional ML integration. We demonstrate our method by rendering dynamic face captures of real actors in a game engine, at comparable photorealism to state-of-the-art neural rendering techniques at previously unseen frame rates.


title: General Item Representation Learning for Cold-start Content Recommendations

abstract: Cold-start item recommendation is a long-standing challenge in recommendation systems. A common remedy is to use a content-based approach, but rich information from raw contents in various forms has not been fully utilized. In this paper, we propose a domain/data-agnostic item representation learning framework for cold-start recommendations, naturally equipped with multimodal alignment among various features by adopting a Transformer-based architecture. Our proposed model is end-to-end trainable completely free from classification labels, not just costly to collect but suboptimal for recommendation-purpose representation learning. From extensive experiments on real-world movie and news recommendation benchmarks, we verify that our approach better preserves fine-grained user taste than state-of-the-art baselines, universally applicable to multiple domains at large scale.


title: Open Cluster Dynamics under the Influence of Outflow-Ambient Interactions

abstract: Outflowing stars impinging upon ambient gas experience accelerations due to the gravitational feedback from the morphology of the interaction betweem the outflow and the ambient gas. Such "negative dynamical friction" (NDF), in contrast to the conventional "dynamical friction" (DF), is studied for its impact on the dynamics of open clusters immersed in a uniform ambient gas. We modify the $N$-body integration code REBOUND with both NDF and DF implemented according to the outflow conditions of each star in a consistently constructed model open cluster. The evolution of stars is also involved in determining the gas-star interactions throughout their stellar lives. Compared to DF-only and gas-free models with identical initial conditions, the NDF-affected cluster is puffier and evaporates faster, as indicated by various diagnostics, including lower velocity dispersions and larger half-mass and half-light radii. Neutron stars with fast winds are expelled from the cluster due to their intensive NDF effect, even without the "kicks" by asymmetric supernovae. Exploration of parameter space confirms that the NDF effect is generally enhanced with higher ambient gas densities, in qualitatively agreement with the expression of acceleration. Outflow-ambient interactions should be considered for the proper interpretation of the evolution of stellar dynamics in clusters.


title: Quasicrystalline chiral soliton lattices in a Fibonacci helimagnet

abstract: We investigate the ground state magnetic configurations of a Fibonacci chain of classical spins with nearest-neighbor ferromagnetic and monoaxial Dzyaloshinskii-Moriya exchange interactions. Our analysis reveals a diverse array of magnetic textures induced by an external magnetic field perpendicular to the Dzyaloshinskii-Moriya vector. These textures exhibit a spectrum ranging from a quasi-fully polarized non-collinear state under high magnetic fields, capable of maintaining metastable chiral soliton topological defects, to a variety of quasicrystalline chiral soliton lattices below a critical field $H_c$. For a range of magnetic fields below $H_c$, the ground state spin textures result from the interplay between an effective quasiperiodic potential influencing the solitons and their repulsive interactions. At lower magnetic fields, the system experiences a commensurate-incommensurate transition, signified by the appearance of discommensurations in the quasicrystalline soliton lattice. In the absence of an external magnetic field, the ground state assumes a helical configuration with a quasiperiodic pitch angle.


title: Multiscale Mixed Methods with Improved Accuracy: The Role of Oversampling and Smoothing

abstract: Multiscale mixed methods based on non-overlapping domain decompositions can efficiently handle the solution of significant subsurface flow problems in very heterogeneous formations of interest to the industry, especially when implemented on multi-core supercomputers. Efficiency in obtaining numerical solutions is dictated by the choice of interface spaces that are selected: the smaller the dimension of these spaces, the better, in the sense that fewer multiscale basis functions need to be computed, and smaller interface linear systems need to be solved. Thus, in solving large computational problems, it is desirable to work with piecewise constant or linear polynomials for interface spaces. However, for these choices of interface spaces, it is well known that the flux accuracy is of the order of 10-1. This study is dedicated to advancing an efficient and accurate multiscale mixed method aimed at addressing industry-relevant problems. A distinctive feature of our approach involves subdomains with overlapping regions, a departure from conventional methods. We take advantage of the overlapping decomposition to introduce a computationally highly efficient smoothing step designed to rectify small-scale errors inherent in the multiscale solution. The effectiveness of the proposed solver, which maintains a computational cost very close to its predecessors, is demonstrated through a series of numerical studies. Notably, for scenarios involving modestly sized overlapping regions and employing just a few smoothing steps, a substantial enhancement of two orders of magnitude in flux accuracy is achieved with the new approach.


title: A Comparative Study on Enhancing Prediction in Social Network Advertisement through Data Augmentation

abstract: In the ever-evolving landscape of social network advertising, the volume and accuracy of data play a critical role in the performance of predictive models. However, the development of robust predictive algorithms is often hampered by the limited size and potential bias present in real-world datasets. This study presents and explores a generative augmentation framework of social network advertising data. Our framework explores three generative models for data augmentation - Generative Adversarial Networks (GANs), Variational Autoencoders (VAEs), and Gaussian Mixture Models (GMMs) - to enrich data availability and diversity in the context of social network advertising analytics effectiveness. By performing synthetic extensions of the feature space, we find that through data augmentation, the performance of various classifiers has been quantitatively improved. Furthermore, we compare the relative performance gains brought by each data augmentation technique, providing insights for practitioners to select appropriate techniques to enhance model performance. This paper contributes to the literature by showing that synthetic data augmentation alleviates the limitations imposed by small or imbalanced datasets in the field of social network advertising. At the same time, this article also provides a comparative perspective on the practicality of different data augmentation methods, thereby guiding practitioners to choose appropriate techniques to enhance model performance.


title: From LLM to NMT: Advancing Low-Resource Machine Translation with Claude

abstract: We show that Claude 3 Opus, a large language model (LLM) released by Anthropic in March 2024, exhibits stronger machine translation competence than other LLMs. Though we find evidence of data contamination with Claude on FLORES-200, we curate new benchmarks that corroborate the effectiveness of Claude for low-resource machine translation into English. We find that Claude has remarkable \textit{resource efficiency} -- the degree to which the quality of the translation model depends on a language pair's resource level. Finally, we show that advancements in LLM translation can be compressed into traditional neural machine translation (NMT) models. Using Claude to generate synthetic data, we demonstrate that knowledge distillation advances the state-of-the-art in Yoruba-English translation, meeting or surpassing strong baselines like NLLB-54B and Google Translate.


title: Discovering Quirks through Timing at FASER and Future Forward Experiments at the LHC

abstract: Quirks are generic predictions of strongly-coupled dark sectors. For weak-scale masses and a broad range of confining scales in the dark sector, quirks can be discovered only at the energy frontier, but quirk--anti-quirk pairs are produced with unusual signatures at low $p_T$, making them difficult to detect at the large LHC detectors. We determine the prospects for discovering quirks using timing information at FASER, FASER2, and an "ultimate detector" in the far-forward region at the LHC. NLO QCD corrections are incorporated in the simulation of quirk production, which can significantly increase the production rate. To accurately propagate quirk pairs from the ATLAS interaction point to the forward detectors, the ionization energy loss of charged quirks traveling through matter, the radiation of infracolor glueballs and QCD hadrons during quirk pair oscillations, and the annihilation of quirkonium are properly considered. The quirk signal is separated from the large muon background using timing information from scintillator detectors by requiring either two coincident delayed tracks, based on arrival times at the detector, or two coincident slow tracks, based on time differences between hits in the front and back scintillators. We find that simple cuts preserve much of the signal, but reduce the muon background to negligible levels. With the data already collected, FASER can discover quirks in currently unconstrained parameter space. FASER2, running at the Forward Physics Facility during the HL-LHC era, will greatly extend this reach, probing the TeV-scale quirk masses motivated by the gauge hierarchy problem for the broad range of dark-sector confining scales between 100 eV and 100 keV.


title: Improving Group Robustness on Spurious Correlation Requires Preciser Group Inference

abstract: Standard empirical risk minimization (ERM) models may prioritize learning spurious correlations between spurious features and true labels, leading to poor accuracy on groups where these correlations do not hold. Mitigating this issue often requires expensive spurious attribute (group) labels or relies on trained ERM models to infer group labels when group information is unavailable. However, the significant performance gap in worst-group accuracy between using pseudo group labels and using oracle group labels inspires us to consider further improving group robustness through preciser group inference. Therefore, we propose GIC, a novel method that accurately infers group labels, resulting in improved worst-group performance. GIC trains a spurious attribute classifier based on two key properties of spurious correlations: (1) high correlation between spurious attributes and true labels, and (2) variability in this correlation between datasets with different group distributions. Empirical studies on multiple datasets demonstrate the effectiveness of GIC in inferring group labels, and combining GIC with various downstream invariant learning methods improves worst-group accuracy, showcasing its powerful flexibility. Additionally, through analyzing the misclassifications in GIC, we identify an interesting phenomenon called semantic consistency, which may contribute to better decoupling the association between spurious attributes and labels, thereby mitigating spurious correlation. The code for GIC is available at https://github.com/yujinhanml/GIC.


title: Neural Radiance Field in Autonomous Driving: A Survey

abstract: Neural Radiance Field (NeRF) has garnered significant attention from both academia and industry due to its intrinsic advantages, particularly its implicit representation and novel view synthesis capabilities. With the rapid advancements in deep learning, a multitude of methods have emerged to explore the potential applications of NeRF in the domain of Autonomous Driving (AD). However, a conspicuous void is apparent within the current literature. To bridge this gap, this paper conducts a comprehensive survey of NeRF's applications in the context of AD. Our survey is structured to categorize NeRF's applications in Autonomous Driving (AD), specifically encompassing perception, 3D reconstruction, simultaneous localization and mapping (SLAM), and simulation. We delve into in-depth analysis and summarize the findings for each application category, and conclude by providing insights and discussions on future directions in this field. We hope this paper serves as a comprehensive reference for researchers in this domain. To the best of our knowledge, this is the first survey specifically focused on the applications of NeRF in the Autonomous Driving domain.


title: Photometric Re-calibration of VPHAS+ $u$-band Photometry with the Stellar Colour Regression Method and Gaia DR3

abstract: The u band magnitude is vital for determining stellar parameters and investigating specific astronomical objects. However, flux calibration in the u band for stars in the Galactic disk presents significant challenges. In this study, we introduce a comprehensive re-calibration of $u$-band photometric magnitudes of the VPHAS+ Data Release 4 (DR4), employing the Stellar Colour Regression (SCR) technique. By leveraging the expansive set of XP spectra and $G_{\rm BP}$ photometry from Gaia Data Release 3 (DR3), as well as the individual stellar extinction values provided by the literature, we have obtained precise model magnitudes of nearly 3 million stars. Our analysis identifies systematic magnitude offsets that exhibit a standard deviation of 0.063 mag across different observational visits, 0.022 mag between various CCDs, and 0.009 mag within pixel bins. We have implemented precise corrections for these observational visits, CCD chips, and pixel bins-dependent magnitude offsets. These corrections have led to a reduction in the standard deviation between the observed magnitudes and the model magnitudes from 0.088 mag to 0.065 mag, ensuring that the calibrated magnitudes are independent of stellar magnitude, colour, and extinction. The enhanced precision of these magnitudes substantially improves the quality of astrophysical research and offers substantial potential for furthering our understanding of stellar astrophysics.


title: Joint Liability Model with Adaptation to Climate Change

abstract: This paper extends the application of ESG score assessment methodologies from large corporations to individual farmers' production, within the context of climate change. Our proposal involves the integration of crucial agricultural sustainability variables into conventional personal credit evaluation frameworks, culminating in the formulation of a holistic sustainable credit rating referred to as the Environmental, Social, Economics (ESE) score. This ESE score is integrated into theoretical joint liability models, to gain valuable insights into optimal group sizes and individual-ESE score relationships. Additionally, we adopt a mean-variance utility function for farmers to effectively capture the risk associated with anticipated profits. Through a set of simulation exercises, the paper investigates the implications of incorporating ESE scores into credit evaluation systems, offering a nuanced comprehension of the repercussions under various climatic conditions.


title: HOIST-Former: Hand-held Objects Identification, Segmentation, and Tracking in the Wild

abstract: We address the challenging task of identifying, segmenting, and tracking hand-held objects, which is crucial for applications such as human action segmentation and performance evaluation. This task is particularly challenging due to heavy occlusion, rapid motion, and the transitory nature of objects being hand-held, where an object may be held, released, and subsequently picked up again. To tackle these challenges, we have developed a novel transformer-based architecture called HOIST-Former. HOIST-Former is adept at spatially and temporally segmenting hands and objects by iteratively pooling features from each other, ensuring that the processes of identification, segmentation, and tracking of hand-held objects depend on the hands' positions and their contextual appearance. We further refine HOIST-Former with a contact loss that focuses on areas where hands are in contact with objects. Moreover, we also contribute an in-the-wild video dataset called HOIST, which comprises 4,125 videos complete with bounding boxes, segmentation masks, and tracking IDs for hand-held objects. Through experiments on the HOIST dataset and two additional public datasets, we demonstrate the efficacy of HOIST-Former in segmenting and tracking hand-held objects.


title: Prove Symbolic Regression is NP-hard by Symbol Graph

abstract: Symbolic regression (SR) is the task of discovering a symbolic expression that fits a given data set from the space of mathematical expressions. Despite the abundance of research surrounding the SR problem, there's a scarcity of works that confirm its NP-hard nature. Therefore, this paper introduces the concept of a symbol graph as a comprehensive representation of the entire mathematical expression space, effectively illustrating the NP-hard characteristics of the SR problem. Leveraging the symbol graph, we establish a connection between the SR problem and the task of identifying an optimally fitted degree-constrained Steiner Arborescence (DCSAP). The complexity of DCSAP, which is proven to be NP-hard, directly implies the NP-hard nature of the SR problem.


title: Robotic Blended Sonification: Consequential Robot Sound as Creative Material for Human-Robot Interaction

abstract: Current research in robotic sounds generally focuses on either masking the consequential sound produced by the robot or on sonifying data about the robot to create a synthetic robot sound. We propose to capture, modify, and utilise rather than mask the sounds that robots are already producing. In short, this approach relies on capturing a robot's sounds, processing them according to contextual information (e.g., collaborators' proximity or particular work sequences), and playing back the modified sound. Previous research indicates the usefulness of non-semantic, and even mechanical, sounds as a communication tool for conveying robotic affect and function. Adding to this, this paper presents a novel approach which makes two key contributions: (1) a technique for real-time capture and processing of consequential robot sounds, and (2) an approach to explore these sounds through direct human-robot interaction. Drawing on methodologies from design, human-robot interaction, and creative practice, the resulting 'Robotic Blended Sonification' is a concept which transforms the consequential robot sounds into a creative material that can be explored artistically and within application-based studies.


title: Higher-Order Graphon Theory: Fluctuations, Degeneracies, and Inference

abstract: Exchangeable random graphs, which include some of the most widely studied network models, have emerged as the mainstay of statistical network analysis in recent years. Graphons, which are the central objects in graph limit theory, provide a natural way to sample exchangeable random graphs. It is well known that network moments (motif/subgraph counts) identify a graphon (up to an isomorphism), hence, understanding the sampling distribution of subgraph counts in random graphs sampled from a graphon is pivotal for nonparametric network inference. In this paper, we derive the joint asymptotic distribution of any finite collection of network moments in random graphs sampled from a graphon, that includes both the non-degenerate case (where the distribution is Gaussian) as well as the degenerate case (where the distribution has both Gaussian or non-Gaussian components). This provides the higher-order fluctuation theory for subgraph counts in the graphon model. We also develop a novel multiplier bootstrap for graphons that consistently approximates the limiting distribution of the network moments (both in the Gaussian and non-Gaussian regimes). Using this and a procedure for testing degeneracy, we construct joint confidence sets for any finite collection of motif densities. This provides a general framework for statistical inference based on network moments in the graphon model. To illustrate the broad scope of our results we also consider the problem of detecting global structure (that is, testing whether the graphon is a constant function) based on small subgraphs. We propose a consistent test for this problem, invoking celebrated results on quasi-random graphs, and derive its limiting distribution both under the null and the alternative.


title: Thouless pumping and trapping of two-component gap solitons

abstract: We study Thouless pumping and arresting of gap solitons in a two-component Bose gas loaded into an optical superlattice. We show that, depending on the atomic interactions and chemical potentials, the two solitons can be simultaneously pumped or trapped, but we also identify regimes where one soliton is pumped and the other arrested. These behaviors can be understood by considering an effective model of the system based on a variational approach, which reveals that the soliton width is a suitable qualifier for the observed behaviours: solitons with a larger width get transported, while solitons with a smaller width get trapped. Since these width can be controlled by tuning interactions, it should be possible to observe all behaviours experimentally.


title: General-Relativistic Magnetohydrodynamic Equations: the bare essential

abstract: Recent years have seen a significant progress in the development of general relativistic codes for the numerical solution of the equations of magnetohydrodynamics in spacetimes with high and dynamical curvature. These codes are valuable tools to explore the large-scale plasma dynamics such as that takes place when two neutron stars collide or when matter accretes onto a supermassive black hole. This chapter is meant to provide a very brief but complete overview of the set of equations that are normally solved in modern numerical codes after they are cast into a conservative formulation within a 3+1 split of spacetime.


title: Change-point analysis for binomial autoregressive model with application to price stability counts

abstract: The first-order binomial autoregressive (BAR(1)) model is the most frequently used tool to analyze the bounded count time series. The BAR(1) model is stationary and assumes process parameters to remain constant throughout the time period, which may be incompatible with the non-stationary real data, which indicates piecewise stationary characteristic. To better analyze the non-stationary bounded count time series, this article introduces the BAR(1) process with multiple change-points, which contains the BAR(1) model as a special case. Our primary goals are not only to detect the change-points, but also to give a solution to estimate the number and locations of the change-points. For this, the cumulative sum (CUSUM) test and minimum description length (MDL) principle are employed to deal with the testing and estimation problems. The proposed approaches are also applied to analysis of the Harmonised Index of Consumer Prices of the European Union.


title: Formation of the four terrestrial planets in the Jupiter-Saturn chaotic excitation scenario: fundamental properties and water delivery

abstract: The Jupiter-Saturn chaotic excitation (JSCE) scenario proposes that the protoplanetary disk was dynamically excited and depleted beyond ~1-1.5 au in a few Myr, offering a new and plausible explanation for several observed properties of the inner solar system. Here, we expanded our previous work by conducting a comprehensive analysis of 37 optimal terrestrial planet systems obtained in the context of the JSCE scenario. Each optimal system harbored exactly four terrestrial planets analogs to Mercury, Venus, Earth, and Mars. We further investigated water delivery, feeding zones, and accretion history for the planet analogs, which allowed us to better constrain the water distribution in the disk. The main findings of this work are as follows: 1) the formation of four terrestrial planets with orbits and masses similar to those observed in our solar system in most of our sample, as evidenced by the dynamically colder and hotter orbits of Venus-Earth and Mercury-Mars analogs, and the high success rates of similar mutual orbital separations (~40-85%) and mass ratios of the planets (~70-90%) among the 37 systems; and 2) water was delivered to all terrestrial planets during their formation through the accretion of water-bearing disk objects from beyond ~1-1.5 au. The achievement of Earth's estimated bulk water content required the disk to contain sufficient water mass distributed within those objects initially. This requirement implies that Mercury, Venus, and Mars acquired water similar to the amount on Earth during their formation. Several of our planet analogs also matched additional constraints, such as the timing of Moon formation by a giant impact, Earth's late accretion mass and composition, and Mars's formation timescale.


title: Swap It Like Its Hot: Segmentation-based spoof attacks on eye-tracking images

abstract: Video-based eye trackers capture the iris biometric and enable authentication to secure user identity. However, biometric authentication is susceptible to spoofing another user's identity through physical or digital manipulation. The current standard to identify physical spoofing attacks on eye-tracking sensors uses liveness detection. Liveness detection classifies gaze data as real or fake, which is sufficient to detect physical presentation attacks. However, such defenses cannot detect a spoofing attack when real eye image inputs are digitally manipulated to swap the iris pattern of another person. We propose IrisSwap as a novel attack on gaze-based liveness detection. IrisSwap allows attackers to segment and digitally swap in a victim's iris pattern to fool iris authentication. Both offline and online attacks produce gaze data that deceives the current state-of-the-art defense models at rates up to 58% and motivates the need to develop more advanced authentication methods for eye trackers.


title: Unique multistable states in periodic structures with saturable nonlinearity. II. Broken $\mathcal{PT}$-symmetric regime

abstract: In this work, we observe that the $\mathcal{PT}$-symmetric fiber Bragg gratings (PTFBGs) with saturable nonlinearity (SNL) exhibit ramp-like, mixed, optical multistability (OM) in the broken regime. The interplay between nonlinearity and detuning parameter plays a central role in transforming the characteristics of the hysteresis curves and facilitates the realization of different OM curves. Also, it plays a crucial role in reducing the switch-up and down intensities of various stable branches of an OM curve. In a mixed OM curve, either the ramp-like hysteresis curves or S-like hysteresis curves can appear predominantly depending on the magnitude of the detuning parameter. An increase in the device length or nonlinearity increases the number of stable states for fixed values of input intensity. Under a reversal in the direction of light incidence, the ramp-like OM and mixed OM curves assume an unusual vortex-like envelope at lower intensities. Numerical simulations reveal that the switch-up and down intensities of different stable branches of a ramp-like OM and mixed OM curves drift towards the higher and lower intensity sides, respectively (opposite direction). The drift is severe to the extent that an intermediate hysteresis curve features switch-down action at near-zero switching intensities. Also, the input intensities required to realize ramp-like, and mixed OM curves reduce dramatically under a reversal in the direction of light incidence.


title: GazeIntent: Adapting dwell-time selection in VR interaction with real-time intent modeling

abstract: The use of ML models to predict a user's cognitive state from behavioral data has been studied for various applications which includes predicting the intent to perform selections in VR. We developed a novel technique that uses gaze-based intent models to adapt dwell-time thresholds to aid gaze-only selection. A dataset of users performing selection in arithmetic tasks was used to develop intent prediction models (F1 = 0.94). We developed GazeIntent to adapt selection dwell times based on intent model outputs and conducted an end-user study with returning and new users performing additional tasks with varied selection frequencies. Personalized models for returning users effectively accounted for prior experience and were preferred by 63% of users. Our work provides the field with methods to adapt dwell-based selection to users, account for experience over time, and consider tasks that vary by selection frequency


title: A Comprehensive Survey and Taxonomy on Point Cloud Registration Based on Deep Learning

abstract: Point cloud registration (PCR) involves determining a rigid transformation that aligns one point cloud to another. Despite the plethora of outstanding deep learning (DL)-based registration methods proposed, comprehensive and systematic studies on DL-based PCR techniques are still lacking. In this paper, we present a comprehensive survey and taxonomy of recently proposed PCR methods. Firstly, we conduct a taxonomy of commonly utilized datasets and evaluation metrics. Secondly, we classify the existing research into two main categories: supervised and unsupervised registration, providing insights into the core concepts of various influential PCR models. Finally, we highlight open challenges and potential directions for future research. A curated collection of valuable resources is made available at https://github.com/yxzhang15/PCR.


title: Data-Driven Performance Guarantees for Classical and Learned Optimizers

abstract: We introduce a data-driven approach to analyze the performance of continuous optimization algorithms using generalization guarantees from statistical learning theory. We study classical and learned optimizers to solve families of parametric optimization problems. We build generalization guarantees for classical optimizers, using a sample convergence bound, and for learned optimizers, using the Probably Approximately Correct (PAC)-Bayes framework. To train learned optimizers, we use a gradient-based algorithm to directly minimize the PAC-Bayes upper bound. Numerical experiments in signal processing, control, and meta-learning showcase the ability of our framework to provide strong generalization guarantees for both classical and learned optimizers given a fixed budget of iterations. For classical optimizers, our bounds are much tighter than those that worst-case guarantees provide. For learned optimizers, our bounds outperform the empirical outcomes observed in their non-learned counterparts.


title: Characterization of Maximizers in A Non-Convex Geometric Optimization Problem With Application to Optical Wireless Power Transfer Systems

abstract: This research studies a non-convex geometric optimization problem arising from the field of optical wireless power transfer. In the considered optimization problem, the cost function is a sum of negatively and fractionally powered distances from given points arbitrarily located in a plane to another point belonging to a different plane. Therefore, it is a strongly nonlinear and non-convex programming, hence posing a challenge on the characterization of its optimizer set, especially its set of global optimizers. To tackle this challenge, the bifurcation theory is employed to investigate the continuation and bifurcation structures of the Hessian matrix of the cost function. As such, two main results are derived. First, there is a critical distance between the two considered planes such that beyond which a unique global optimizer exists. Second, the exact number of maximizers is locally derived by the number of bifurcation branches determined via one-dimensional isotropic subgroups of a Lie group acting on $\mathbb{R}^2$, when the inter-plane distance is smaller than the above-mentioned critical distance. Consequently, numerical simulations and computations of bifurcation points are carried out for various configurations of the given points, whose results confirm the derived theoretical outcomes.


title: The Self-Consistency of DESI Analysis and Comment on "Does DESI 2024 Confirm $\Lambda$CDM?"

abstract: We demonstrate that the constraints on the evolution of dark energy implemented by the DESI collaboration may be insufficient or incomplete using their own BAO data. Using large enough prior ranges for the present-day equation of state of dark energy $\omega_0$ and amplitude of dark energy evolution $\omega_a$, we obtain the complete $1\,\sigma$ and $2\,\sigma$ constraints $\omega_0=1.04^{+0.91+2.00}_{-1.00-1.90}$ and $\omega_a=-7.4^{+3.8+6.8}_{-3.2-7.3}$ indicating a beyond $2\,\sigma$ preference of quintessence-like dark energy today and an evidence of evolving dark energy at beyond $2\,\sigma$ CL, respectively. Our results are different from $\omega_0=-0.55^{+0.39}_{-0.21}$ and the $2\,\sigma$ upper limit $\omega_a<-1.32$ reported by the DESI collaboration \cite{DESI:2024mwx}. Employing a data combination of cosmic microwave background, DESI BAO and type Ia supernova, we obtain the $1\,\sigma$, $2\,\sigma$ and $3\,\sigma$ constraints $\omega_0=-0.707^{+0.089+0.18+0.24}_{-0.089-0.17-0.22}$ and $\omega_a=-1.09^{+0.38+0.67+0.82}_{-0.31-0.72-1.00}$, which reveals a $\sim4\,\sigma$ evidence of dynamical dark energy when the redshift $z\lesssim0.1$. We verify that the BAO data point from luminous red galaxies at the effective redshift $z_{\rm eff}=0.51$ hardly affects the joint constraint from the data combination of cosmic microwave background, DESI BAO and type Ia supernova. We also point out the shortcomings and advantages of the binning method widely used in cosmological analyses.

categories: astro-ph.CO astro-ph.HE gr-qc hep-ph hep-th


title: Inference for multiple change-points in generalized integer-valued autoregressive model

abstract: In this paper, we propose a computationally valid and theoretically justified methods, the likelihood ratio scan method (LRSM), for estimating multiple change-points in a piecewise stationary generalized conditional integer-valued autoregressive process. LRSM with the usual window parameter $h$ is more satisfied to be used in long-time series with few and even change-points vs. LRSM with the multiple window parameter $h_{mix}$ performs well in short-time series with large and dense change-points. The computational complexity of LRSM can be efficiently performed with order $O((\log n)^3 n)$. Moreover, two bootstrap procedures, namely parametric and block bootstrap, are developed for constructing confidence intervals (CIs) for each of the change-points. Simulation experiments and real data analysis show that the LRSM and bootstrap procedures have excellent performance and are consistent with the theoretical analysis.


title: Finding accreted stars in the Milky Way: clues from NIHAO simulations

abstract: Exploring the marks left by galactic accretion in the Milky Way helps us understand how our Galaxy was formed. However, finding and studying accreted stars and the galaxies they came from has been challenging. This study uses a simulation from the NIHAO project, which now includes a wider range of chemical compositions, to find better ways to spot these accreted stars. By comparing our findings with data from the GALAH spectroscopic survey, we confirm that the observationally established diagnostics of [Al/Fe] vs. [Mg/Mn] also show a separation of in-situ and accreted stars in the simulation, but stars from different accretion events tend to overlap in this plane even without observational uncertainties. Looking at the relationship between stellar age and linear or logarithmic abundances, such as [Fe/H], we can clearly separate different groups of these stars if the uncertainties in their chemical makeup are less than 0.15 dex and less than 20% for their ages. This method shows promise for studying the history of the Milky Way and other galaxies. Our work highlights how important it is to have accurate measurements of stellar ages and chemical content. It also shows how simulations can help us understand the complex process of galaxies merging and suggest how these events might relate to the differences we see between our Galaxy's thin and thick disk stars. This study provides a way to compare theoretical models with real observations, opening new paths for research in both our own Galaxy and beyond.


title: MultiFun-DAG: Multivariate Functional Directed Acyclic Graph

abstract: Directed Acyclic Graphical (DAG) models efficiently formulate causal relationships in complex systems. Traditional DAGs assume nodes to be scalar variables, characterizing complex systems under a facile and oversimplified form. This paper considers that nodes can be multivariate functional data and thus proposes a multivariate functional DAG (MultiFun-DAG). It constructs a hidden bilinear multivariate function-to-function regression to describe the causal relationships between different nodes. Then an Expectation-Maximum algorithm is used to learn the graph structure as a score-based algorithm with acyclic constraints. Theoretical properties are diligently derived. Prudent numerical studies and a case study from urban traffic congestion analysis are conducted to show MultiFun-DAG's effectiveness.


title: The effect of local photoionization on the galaxy properties and the circumgalactic medium in simulations of Milky Way-sized galaxies

abstract: In this study, we investigate the impact of local stellar radiation in cosmological zoom simulations of the formation of Milky Way-sized galaxies. We include the radiation field as an additional feedback component that is computed alongside gravity with a tree code in an optically thin approximation. We resimulate the initial conditions of five Milk Way-like systems taken from the Auriga project with and without stellar radiation, and study the effects of local stellar radiation on several properties of the galaxies and the circumgalactic medium (CGM). Similar to previous findings, we observe that local stellar radiation can modify gas cooling in the circumgalactic medium and thus suppress star formation and the surface densities of young stars and HI gas, while having little impact on the total gas content. Even though the magnitude of the effect we find is smaller than reported in earlier work, the radiation field is thus clearly an important component in simulations of late time galaxies. In particular, it also suppresses the peak of the rotation curve and reduces the mass of the stellar bulge. In the CGM region, the young stellar radiation exceeds the external UVB and dominates the radiation field within the virial halo at all redshifts. Nevertheless, we find that the local stellar radiation has overall little impact on the radial density and temperature profile of the CGM gas. The metallicity profile is slightly reduced, however, as well as the HI and MgII column densities within $\sim 0.3\,R_{\rm vir}$. In contrast, we find that the OVI column density is hardly impacted by the radiation field. Additional effects can be expected from the radiation of the central AGN during phases of quasar activity, which has not yet been included in the simulations of the present study.


title: C2F-SemiCD: A Coarse-to-Fine Semi-Supervised Change Detection Method Based on Consistency Regularization in High-Resolution Remote Sensing Images

abstract: A high-precision feature extraction model is crucial for change detection (CD). In the past, many deep learning-based supervised CD methods learned to recognize change feature patterns from a large number of labelled bi-temporal images, whereas labelling bi-temporal remote sensing images is very expensive and often time-consuming; therefore, we propose a coarse-to-fine semi-supervised CD method based on consistency regularization (C2F-SemiCD), which includes a coarse-to-fine CD network with a multiscale attention mechanism (C2FNet) and a semi-supervised update method. Among them, the C2FNet network gradually completes the extraction of change features from coarse-grained to fine-grained through multiscale feature fusion, channel attention mechanism, spatial attention mechanism, global context module, feature refine module, initial aggregation module, and final aggregation module. The semi-supervised update method uses the mean teacher method. The parameters of the student model are updated to the parameters of the teacher Model by using the exponential moving average (EMA) method. Through extensive experiments on three datasets and meticulous ablation studies, including crossover experiments across datasets, we verify the significant effectiveness and efficiency of the proposed C2F-SemiCD method. The code will be open at: https://github.com/ChengxiHAN/C2F-SemiCDand-C2FNet.


title: On a conjecture of Gross, Mansour and Tucker for $\Delta$-matroids

abstract: Gross, Mansour, and Tucker introduced the partial-duality polynomial of a ribbon graph [Distributions, European J. Combin. 86, 1--20, 2020], the generating function enumerating partial duals by the Euler genus. Chmutov and Vignes-Tourneret wondered if this polynomial and its conjectured properties would hold for general delta-matroids, which are combinatorial abstractions of ribbon graphs. Yan and Jin contributed to this inquiry by identifying a subset of delta-matroids-specifically, even normal binary ones-whose twist polynomials are characterized by a singular term. Building upon this foundation, the current paper expands the scope of the investigation to encompass even non-binary delta-matroids, revealing that none of them have width-changing twists.


title: Study of $e^+e^-\to\omega X(3872)$ and $\gamma X(3872)$ from 4.66 to 4.95 GeV

abstract: Using data samples with an integrated luminosity of $4.5~\text{fb}^{-1}$ collected by the BESIII detector at center-of-mass energies ranging from 4.66 to 4.95 GeV, we study the processes of $e^+e^-\to\omega X(3872)$ and $e^+e^-\to\gamma X(3872)$. With the $e^+e^-\to\omega X(3872)$ process, the branching fraction ratio $R\equiv\frac{\mathcal{B}(X(3872)\to\gamma J/\psi)}{\mathcal{B}(X(3872)\to\pi^+\pi^- J/\psi)}$ is measured to be $0.38\pm0.20_\text{stat.}\pm0.01_\text{syst.}$ ($R< 0.83$ at 90\% confidence level). In addition, we measure the ratio of the average cross section of $e^+e^-\to\omega X(3872)$ to $e^+e^-\to\omega \chi_{c1}(\omega\chi_{c2})$ to be $\sigma_{\omega X(3872)}/\sigma_{\omega\chi_{c1}}~(\sigma_{\omega X(3872)}/\sigma_{\omega\chi_{c2}})=5.2\pm1.0_\text{stat.}\pm1.9_\text{syst.}~ (5.5\pm1.1_\text{stat.}\pm2.4_\text{syst.})$. Finally, we search for the process of $e^+e^-\to\gamma X(3872)$, and no obvious signal is observed. The upper limit on the ratio of the average cross section of $e^+e^-\to\gamma X(3872)$ to $e^+e^-\to\omega X(3872)$ is set as $\sigma_{\gamma X(3872)}/\sigma_{\omega X(3872)}<0.23$ at 90\% confidence level.


title: Fair Concurrent Training of Multiple Models in Federated Learning

abstract: Federated learning (FL) enables collaborative learning across multiple clients. In most FL work, all clients train a single learning task. However, the recent proliferation of FL applications may increasingly require multiple FL tasks to be trained simultaneously, sharing clients' computing and communication resources, which we call Multiple-Model Federated Learning (MMFL). Current MMFL algorithms use naive average-based client-task allocation schemes that can lead to unfair performance when FL tasks have heterogeneous difficulty levels, e.g., tasks with larger models may need more rounds and data to train. Just as naively allocating resources to generic computing jobs with heterogeneous resource needs can lead to unfair outcomes, naive allocation of clients to FL tasks can lead to unfairness, with some tasks having excessively long training times, or lower converged accuracies. Furthermore, in the FL setting, since clients are typically not paid for their training effort, we face a further challenge that some clients may not even be willing to train some tasks, e.g., due to high computational costs, which may exacerbate unfairness in training outcomes across tasks. We address both challenges by firstly designing FedFairMMFL, a difficulty-aware algorithm that dynamically allocates clients to tasks in each training round. We provide guarantees on airness and FedFairMMFL's convergence rate. We then propose a novel auction design that incentivizes clients to train multiple tasks, so as to fairly distribute clients' training efforts across the tasks. We show how our fairness-based learning and incentive mechanisms impact training convergence and finally evaluate our algorithm with multiple sets of learning tasks on real world datasets.


title: On Support Relations Inference and Scene Hierarchy Graph Construction from Point Cloud in Clustered Environments

abstract: Over the years, scene understanding has attracted a growing interest in computer vision, providing the semantic and physical scene information necessary for robots to complete some particular tasks autonomously. In 3D scenes, rich spatial geometric and topological information are often ignored by RGB-based approaches for scene understanding. In this study, we develop a bottom-up approach for scene understanding that infers support relations between objects from a point cloud. Our approach utilizes the spatial topology information of the plane pairs in the scene, consisting of three major steps. 1) Detection of pairwise spatial configuration: dividing primitive pairs into local support connection and local inner connection; 2) primitive classification: a combinatorial optimization method applied to classify primitives; and 3) support relations inference and hierarchy graph construction: bottom-up support relations inference and scene hierarchy graph construction containing primitive level and object level. Through experiments, we demonstrate that the algorithm achieves excellent performance in primitive classification and support relations inference. Additionally, we show that the scene hierarchy graph contains rich geometric and topological information of objects, and it possesses great scalability for scene understanding.


title: Co-evolution of dust grains and protoplanetary disks II: structure and evolution of protoplanetary disks; an analytical approach

abstract: In our previous study (Tsukamoto {\it et al.} 2023), we investigated formation and early evolution of protoplanetary disks with 3D non-ideal magnetohydrodynamics simulations considering dust growth, and found that the modified equations of the conventional steady accretion disk model which consider the magnetic braking, { dust growth} and ambipolar diffusion reproduce the disk structure obtained from simulations very well. In this paper, as a sequel of the our previous study, we analytically investigate the structure and evolution of protoplanetary disks corresponding to Class 0/I young stellar objects using the modified steady accretion disk model combining an analytical model of envelope accretion. We estimate that the disk radius is several AU at disk formation epoch and increases to several 100 AU at the end of the accretion phase. The disk mass is estimated to be $0.01 M_\odot \lesssim M_{\rm disk} \lesssim 0.1 M_\odot$ for a disk with radius of several 10 AU and mass accretion rate of $\dot{M}_{\rm disk} \sim 10^{-6} M_\odot {\rm yr^{-1}}$. We also found that, with typical disk ionization rates and moderate mass accretion rate ($\dot{M}_{\rm disk}\gtrsim10^{-8} M_\odot {\rm yr^{-1}}$), magneto-rotational instability is suppressed in the disk because of low plasma $\beta$ and efficient ambipolar diffusion. We argue that the radial profile of specific angular momentum (or rotational velocity) at the disk outer edge should be continuously connected to that of the envelope if the disk evolves by magnetic braking, and should be discontinuous if the disk evolves by internal angular momentum transport process such as gravitational instability or magneto-rotational instability. Future detailed observations of the specific angular momentum profile around the disk outer edge are important for understanding the angular momentum transport mechanism of protoplanetary disks.


title: ColA: Collaborative Adaptation with Gradient Learning

abstract: A primary function of back-propagation is to compute both the gradient of hidden representations and parameters for optimization with gradient descent. Training large models requires high computational costs due to their vast parameter sizes. While Parameter-Efficient Fine-Tuning (PEFT) methods aim to train smaller auxiliary models to save computational space, they still present computational overheads, especially in Fine-Tuning as a Service (FTaaS) for numerous users. We introduce Collaborative Adaptation (ColA) with Gradient Learning (GL), a parameter-free, model-agnostic fine-tuning approach that decouples the computation of the gradient of hidden representations and parameters. In comparison to PEFT methods, ColA facilitates more cost-effective FTaaS by offloading the computation of the gradient to low-cost devices. We also provide a theoretical analysis of ColA and experimentally demonstrate that ColA can perform on par or better than existing PEFT methods on various benchmarks.


title: Stochastic thermodynamics of Brownian motion in a flowing fluid

abstract: We study stochastic thermodynamics of over-damped Brownian motion in a flowing fluid. Unlike some previous works, we treat the effects of the flow field as a non-conservational driving force acting on the Brownian particle. This allows us to apply the theoretical formalism developed in a recent work for general non-conservative Langevin dynamics. We define heat and work both at the trajectory level and at the ensemble level, and prove the second law of thermodynamics explicitly. The entropy production (EP) is decomposed into a housekeeping part and an excess part, both of which are non-negative at the ensemble level. Fluctuation theorems are derived for the housekeeping work, the excess work, and the total work, which are further verified using numerical simulations. A comparison between our theory and an earlier theory by Speck et. al. is also carried out.


title: Filtered Direct Preference Optimization

abstract: Reinforcement learning from human feedback (RLHF) plays a crucial role in aligning language models with human preferences. While the significance of dataset quality is generally recognized, explicit investigations into its impact within the RLHF framework, to our knowledge, have been limited. This paper addresses the issue of text quality within the preference dataset by focusing on Direct Preference Optimization (DPO), an increasingly adopted reward-model-free RLHF method. We confirm that text quality significantly influences the performance of models optimized with DPO more than those optimized with reward-model-based RLHF. Building on this new insight, we propose an extension of DPO, termed filtered direct preference optimization (fDPO). fDPO uses a trained reward model to monitor the quality of texts within the preference dataset during DPO training. Samples of lower quality are discarded based on comparisons with texts generated by the model being optimized, resulting in a more accurate dataset. Experimental results demonstrate that fDPO enhances the final model performance. Our code is available at https://github.com/CyberAgentAILab/filtered-dpo.