title: Electrically tuned topology and magnetism in twisted bilayer MoTe$_2$ at $\nu_h=1$

abstract: We present a theoretical study of an interaction-driven quantum phase diagram of twisted bilayer MoTe$_2$ at hole filling factor $\nu_h=1$ as a function of twist angle $\theta$ and layer potential difference $V_z$, where $V_z$ is generated by an applied out-of-plane electric field. At $V_z=0$, the phase diagram includes quantum anomalous Hall insulators in the intermediate $\theta$ regime and topologically trivial multiferroic states with coexisting ferroelectricity and magnetism in both small and large $\theta$ regimes. There can be two transitions from the quantum anomalous Hall insulator phase to topologically trivial out-of-plane ferromagnetic phase, and finally to in-plane 120$^\circ$ antiferromagnetic phase as $|V_z|$ increases, or a single transition without the intervening ferromagnetic phase. We show explicitly that the spin vector chirality of various 120$^\circ$ antiferromagnetic states can be electrically switched. We discuss the connection between the experimentally measured Curie-Weiss temperature and the low-temperature magnetic order based on an effective Heisenberg model with magnetic anisotropy.


title: Symmetry-based classification of exact flat bands in single and bilayer moir\'e systems

abstract: We study the influence of spatial symmetries on the appearance and the number of exact flat bands (FBs) in single and bilayer systems with Dirac or quadratic band crossing points, and systematically classify all possible number of exact flat bands in systems with different point group symmetries. We find that a maximum of 6 FBs can be protected by symmetries, and show an example of 6 FBs in a system with QBCP under periodic strain field of $\mathcal{C}_{6v}$ point group symmetry. All known examples of exact FBs in single and bilayer systems fall under this classification, including chiral twisted bilayer graphene, and new examples of exact FBs are found. We show the construction of wavefunctions for the highly degenerate FBs, and prove that any such set of FBs are $\mathds{Z}_2$ nontrivial, where all WFs polarized on one sublattice together have Chern number $C = 1$ and WFs polarized on the other sublattice together have $C = -1$. These bands also satisfy ideal non-Abelian quantum geometry condition. We further show that, just like in TBG, topological heavy fermion description of the FBs with higher degeneracy is possible as long as the Berry curvature distribution is peaked around a point in the BZ.


title: What do we learn from a large-scale study of pre-trained visual representations in sim and real environments?

abstract: We present a large empirical investigation on the use of pre-trained visual representations (PVRs) for training downstream policies that execute real-world tasks. Our study spans five different PVRs, two different policy-learning paradigms (imitation and reinforcement learning), and three different robots for 5 distinct manipulation and indoor navigation tasks. From this effort, we can arrive at three insights: 1) the performance trends of PVRs in the simulation are generally indicative of their trends in the real world, 2) the use of PVRs enables a first-of-its-kind result with indoor ImageNav (zero-shot transfer to a held-out scene in the real world), and 3) the benefits from variations in PVRs, primarily data-augmentation and fine-tuning, also transfer to the real-world performance. See project website for additional details and visuals.


title: The orbital period of the nova V1674 Her as observed with TESS

abstract: Nova Her 2021 was observed with TESS 12.62 days after its most recent outburst in June 12.537 2021. This cataclysmic variable belongs to the intermediate polar class, with an spin period of $\sim$501 s and orbital period of 0.1529 days. During TESS observations of Sector 40, the orbital period of 0.1529(1) days is detected significantly 17 days after the onset of the outburst. A modulation, of unknown origin, with a period of $\sim$0.537 days is present in the data from day 13 until day 17.


title: Structurally guided task decomposition in spatial navigation tasks

abstract: How are people able to plan so efficiently despite limited cognitive resources? We aimed to answer this question by extending an existing model of human task decomposition that can explain a wide range of simple planning problems by adding structure information to the task to facilitate planning in more complex tasks. The extended model was then applied to a more complex planning domain of spatial navigation. Our results suggest that our framework can correctly predict the navigation strategies of the majority of the participants in an online experiment.


title: Spectro-polarimetry of 4U 1957+115 with IXPE: Effects of spin and returning radiation on polarised emission of black hole in thermal state

abstract: We present a comprehensive spectro-polarimetric study of persistent Black hole X-ray binary 4U $1957\!+\!115$ with {\it IXPE} and {\it NICER} observations. The source is observed in disk dominated thermal state with disk temperature, kT$_{in}\approx1.4$ keV. The emission during thermal state from the source is found to be moderately polarized and \textit{IXPE} measures a degree of polarization (PD) $= 1.95\pm0.37\%$ ($>4.79\sigma$) along with a polarization angle (PA) $= -42.78^{\circ}\pm5.41^{\circ}$ in the energy range of $2-8$ keV. PD is found to be an increasing function of energy, whereas PA indicates switching within the energy range which could be due to high inclination and the returning radiation within the system. Simultaneous energy spectra ($0.6-10$ keV) from {\it NICER} are modelled to study the spectral properties. Furthermore, the spin parameter of the black hole is estimated with spectro-polarimetric data as a$_{\ast}=0.988\pm0.001\,(1\sigma)$, which is corroborated by {\it NICER} observations. Finally, we discuss the implications of our findings.


title: Query-Based Sampling of Heterogeneous CTMCs: Modeling and Optimization with Binary Freshness

abstract: We study a remote monitoring system in which a mutually independent and heterogeneous collection of finite-state irreducible continuous time Markov chain (CTMC) based information sources is considered. In this system, a common remote monitor queries the instantaneous states of the individual CTMCs according to a Poisson process with possibly different intensities across the sources, in order to maintain accurate estimates of the original sources. \color{black}Three information freshness models are considered to quantify the accuracy of the remote estimates: fresh when equal (FWE), fresh when sampled (FWS) and fresh when close (FWC). For each of these freshness models, closed-form expressions are derived for mean information freshness for a given source. Using these expressions, optimum sampling rates for all sources are obtained so as to maximize the weighted sum freshness of the monitoring system, subject to an overall sampling rate constraint. This optimization problem leads to a water-filling solution with quadratic worst case computational complexity in the number of information sources. Numerical examples are provided to validate the effectiveness of the optimum sampling policy in comparison to several baseline sampling policies.


title: Can Language Models be Instructed to Protect Personal Information?

abstract: Large multimodal language models have proven transformative in numerous applications. However, these models have been shown to memorize and leak pre-training data, raising serious user privacy and information security concerns. While data leaks should be prevented, it is also crucial to examine the trade-off between the privacy protection and model utility of proposed approaches. In this paper, we introduce PrivQA -- a multimodal benchmark to assess this privacy/utility trade-off when a model is instructed to protect specific categories of personal information in a simulated scenario. We also propose a technique to iteratively self-moderate responses, which significantly improves privacy. However, through a series of red-teaming experiments, we find that adversaries can also easily circumvent these protections with simple jailbreaking methods through textual and/or image inputs. We believe PrivQA has the potential to support the development of new models with improved privacy protections, as well as the adversarial robustness of these protections. We release the entire PrivQA dataset at https://llm-access-control.github.io/.


title: Mapping the Intracluster Medium in the Era of High-resolution X-ray Spectroscopy

abstract: High-resolution spectroscopy in soft X-rays will open a new window to map multiphase gas in galaxy clusters and probe physics of the intracluster medium (ICM), including chemical enrichment histories, circulation of matter and energy during large-scale structure evolution, stellar and black hole feedback, halo virialization, and gas mixing processes. An eV-level spectral resolution, large field-of-view, and effective area are essential to separate cluster emissions from the Galactic foreground and efficiently map the cluster outskirts. Several mission concepts that meet these criteria have been proposed recently, e.g., LEM, HUBS, and SuperDIOS. This theoretical study explores what information on ICM physics could be recovered with such missions and the associated challenges. We emphasize the need for a comprehensive comparison between simulations and observations to interpret the high-resolution spectroscopic observations correctly. Using Line Emission Mapper (LEM) characteristics as an example, we demonstrate that it enables the use of soft X-ray emission lines (e.g., O VII/VIII and Fe-L complex) from the cluster outskirts to measure the thermodynamic, chemical, and kinematic properties of the gas up to $r_{200}$ and beyond. By generating mock observations with full backgrounds, analysing their images/spectra with observational approaches, and comparing the recovered characteristics with true ones from simulations, we develop six key science drivers for future missions, including the exploration of multiphase gas in galaxy clusters (e.g., temperature fluctuations, phase-space distributions), metallicity, ICM gas bulk motions and turbulence power spectra, ICM-cosmic filament interactions, and advances for cluster cosmology.


title: Think before you speak: Training Language Models With Pause Tokens

abstract: Language models generate responses by producing a series of tokens in immediate succession: the $(K+1)^{th}$ token is an outcome of manipulating $K$ hidden vectors per layer, one vector per preceding token. What if instead we were to let the model manipulate say, $K+10$ hidden vectors, before it outputs the $(K+1)^{th}$ token? We operationalize this idea by performing training and inference on language models with a (learnable) $\textit{pause}$ token, a sequence of which is appended to the input prefix. We then delay extracting the model's outputs until the last pause token is seen, thereby allowing the model to process extra computation before committing to an answer. We empirically evaluate $\textit{pause-training}$ on decoder-only models of 1B and 130M parameters with causal pretraining on C4, and on downstream tasks covering reasoning, question-answering, general understanding and fact recall. Our main finding is that inference-time delays show gains when the model is both pre-trained and finetuned with delays. For the 1B model, we witness gains on 8 of 9 tasks, most prominently, a gain of $18\%$ EM score on the QA task of SQuAD, $8\%$ on CommonSenseQA and $1\%$ accuracy on the reasoning task of GSM8k. Our work raises a range of conceptual and practical future research questions on making delayed next-token prediction a widely applicable new paradigm.


title: SNIP: Bridging Mathematical Symbolic and Numeric Realms with Unified Pre-training

abstract: In an era where symbolic mathematical equations are indispensable for modeling complex natural phenomena, scientific inquiry often involves collecting observations and translating them into mathematical expressions. Recently, deep learning has emerged as a powerful tool for extracting insights from data. However, existing models typically specialize in either numeric or symbolic domains, and are usually trained in a supervised manner tailored to specific tasks. This approach neglects the substantial benefits that could arise from a task-agnostic multi-modal understanding between symbolic equations and their numeric counterparts. To bridge the gap, we introduce SNIP, a Symbolic-Numeric Integrated Pre-training model, which employs contrastive learning between symbolic and numeric domains, enhancing their mutual similarities in the embeddings. By performing latent space analysis, we observe that SNIP provides cross-domain insights into the representations, revealing that symbolic supervision enhances the embeddings of numeric data and vice versa. We evaluate SNIP across diverse tasks, including symbolic-to-numeric mathematical property prediction and numeric-to-symbolic equation discovery, commonly known as symbolic regression. Results show that SNIP effectively transfers to various tasks, consistently outperforming fully supervised baselines and competing strongly with established task-specific methods, especially in the low data regime scenarios where available data is limited. Code and model are available at: https://github.com/deep-symbolic-mathematics/Multimodal-Math-Pretraining


title: Uniqueness of least energy solutions to the fractional Lane-Emden equation in the ball

abstract: We prove uniqueness of least-energy solutions to the fractional Lane-Emden equation, under homogeneous Dirichlet exterior conditions, when the underlying domain is a ball $B \subset \mathbb{R}^N$. The equation is characterized by a superlinear, subcritical power-like nonlinearity. The proof makes use of Morse theory and is inspired by some results obtained by C. S. Lin in the '90s. A new Hopf's Lemma-type result shown in this paper is an essential element in the proof of nondegeneracy of least-energy solutions.


title: Extraction of Medication and Temporal Relation from Clinical Text using Neural Language Models

abstract: Clinical texts, represented in electronic medical records (EMRs), contain rich medical information and are essential for disease prediction, personalised information recommendation, clinical decision support, and medication pattern mining and measurement. Relation extractions between medication mentions and temporal information can further help clinicians better understand the patients' treatment history. To evaluate the performances of deep learning (DL) and large language models (LLMs) in medication extraction and temporal relations classification, we carry out an empirical investigation of \textbf{MedTem} project using several advanced learning structures including BiLSTM-CRF and CNN-BiLSTM for a clinical domain named entity recognition (NER), and BERT-CNN for temporal relation extraction (RE), in addition to the exploration of different word embedding techniques. Furthermore, we also designed a set of post-processing roles to generate structured output on medications and the temporal relation. Our experiments show that CNN-BiLSTM slightly wins the BiLSTM-CRF model on the i2b2-2009 clinical NER task yielding 75.67, 77.83, and 78.17 for precision, recall, and F1 scores using Macro Average. BERT-CNN model also produced reasonable evaluation scores 64.48, 67.17, and 65.03 for P/R/F1 using Macro Avg on the temporal relation extraction test set from i2b2-2012 challenges. Code and Tools from MedTem will be hosted at \url{https://github.com/HECTA-UoM/MedTem}


title: Leveraging Diffusion Disentangled Representations to Mitigate Shortcuts in Underspecified Visual Tasks

abstract: Spurious correlations in the data, where multiple cues are predictive of the target labels, often lead to shortcut learning phenomena, where a model may rely on erroneous, easy-to-learn, cues while ignoring reliable ones. In this work, we propose an ensemble diversification framework exploiting the generation of synthetic counterfactuals using Diffusion Probabilistic Models (DPMs). We discover that DPMs have the inherent capability to represent multiple visual cues independently, even when they are largely correlated in the training data. We leverage this characteristic to encourage model diversity and empirically show the efficacy of the approach with respect to several diversification objectives. We show that diffusion-guided diversification can lead models to avert attention from shortcut cues, achieving ensemble diversity performance comparable to previous methods requiring additional data collection.


title: Spin-Spin Coupling at Small $x$: Worm-Gear and Pretzelosity TMDs

abstract: We study the small-$x$ asymptotics of the leading-twist quark transverse momentum dependent parton distribution functions (TMDs) which encode couplings between the polarization of the quarks and that of their parent hadron, with at least one of the two polarizations in the transverse direction: the two worm-gear TMDs $g_{1T}$ and $h_{1L}^{\perp}$, and the pretzelosity $h_{1T}^{\perp}$. We apply the recently developed Light Cone Operator Treatment, finding that in the flavor non-singlet sector all three TMDs reduce in the small-$x$ limit to previously known polarized dipole amplitudes, and thus the large-$N_c$, linearized, Double Logarithmic Approximation (DLA) asymptotics have all been solved for previously. For the worm-gear TMD $g_{1T}$ we find \begin{align} g_{1T}^{\textrm{NS}} (x \ll 1, k_T^2) \sim \left( \frac{1}{x} \right)^0 , \end{align} while for the worm-gear TMD $h_{1L}^{\perp}$ we find \begin{align} h_{1L}^{\perp \textrm{NS}} (x \ll 1, k_T^2) \sim \left( \frac{1}{x} \right)^{-1}. \end{align} Finally, for the pretzelosity TMD $h_{1T}^{\perp}$ we find \begin{align} h_{1 T}^{\perp \textrm{NS}} (x \ll 1, k_T^2) \sim \left( \frac{1}{x} \right)^{-1 + 2 \sqrt{\frac{\alpha_s N_c}{2\pi}}}. \end{align} We have compiled these asymptotics together with those of the other five flavor non-singlet, leading-twist quark TMDs into a single unified table.


title: HoloNets: Spectral Convolutions do extend to Directed Graphs

abstract: Within the graph learning community, conventional wisdom dictates that spectral convolutional networks may only be deployed on undirected graphs: Only there could the existence of a well-defined graph Fourier transform be guaranteed, so that information may be translated between spatial- and spectral domains. Here we show this traditional reliance on the graph Fourier transform to be superfluous and -- making use of certain advanced tools from complex analysis and spectral theory -- extend spectral convolutions to directed graphs. We provide a frequency-response interpretation of newly developed filters, investigate the influence of the basis used to express filters and discuss the interplay with characteristic operators on which networks are based. In order to thoroughly test the developed theory, we conduct experiments in real world settings, showcasing that directed spectral convolutional networks provide new state of the art results for heterophilic node classification on many datasets and -- as opposed to baselines -- may be rendered stable to resolution-scale varying topological perturbations.


abstract: Modern distribution matching algorithms for training diffusion or flow models directly prescribe the time evolution of the marginal distributions between two boundary distributions. In this work, we consider a generalized distribution matching setup, where these marginals are only implicitly described as a solution to some task-specific objective function. The problem setup, known as the Generalized Schr\"odinger Bridge (GSB), appears prevalently in many scientific areas both within and without machine learning. We propose Generalized Schr\"odinger Bridge Matching (GSBM), a new matching algorithm inspired by recent advances, generalizing them beyond kinetic energy minimization and to account for task-specific state costs. We show that such a generalization can be cast as solving conditional stochastic optimal control, for which efficient variational approximations can be used, and further debiased with the aid of path integral theory. Compared to prior methods for solving GSB problems, our GSBM algorithm better preserves a feasible transport map between the boundary distributions throughout training, thereby enabling stable convergence and significantly improved scalability. We empirically validate our claims on an extensive suite of experimental setups, including crowd navigation, opinion depolarization, LiDAR manifolds, and image domain transfer. Our work brings new algorithmic opportunities for training diffusion models enhanced with task-specific optimality structures. Code available at https://github.com/facebookresearch/generalized-schrodinger-bridge-matching


title: MIS-AVoiDD: Modality Invariant and Specific Representation for Audio-Visual Deepfake Detection

abstract: Deepfakes are synthetic media generated using deep generative algorithms and have posed a severe societal and political threat. Apart from facial manipulation and synthetic voice, recently, a novel kind of deepfakes has emerged with either audio or visual modalities manipulated. In this regard, a new generation of multimodal audio-visual deepfake detectors is being investigated to collectively focus on audio and visual data for multimodal manipulation detection. Existing multimodal (audio-visual) deepfake detectors are often based on the fusion of the audio and visual streams from the video. Existing studies suggest that these multimodal detectors often obtain equivalent performances with unimodal audio and visual deepfake detectors. We conjecture that the heterogeneous nature of the audio and visual signals creates distributional modality gaps and poses a significant challenge to effective fusion and efficient performance. In this paper, we tackle the problem at the representation level to aid the fusion of audio and visual streams for multimodal deepfake detection. Specifically, we propose the joint use of modality (audio and visual) invariant and specific representations. This ensures that the common patterns and patterns specific to each modality representing pristine or fake content are preserved and fused for multimodal deepfake manipulation detection. Our experimental results on FakeAVCeleb and KoDF audio-visual deepfake datasets suggest the enhanced accuracy of our proposed method over SOTA unimodal and multimodal audio-visual deepfake detectors by $17.8$% and $18.4$%, respectively. Thus, obtaining state-of-the-art performance.


title: Automatic Quality Assessment of Wikipedia Articles -- A Systematic Literature Review

abstract: Wikipedia is the world's largest online encyclopedia, but maintaining article quality through collaboration is challenging. Wikipedia designed a quality scale, but with such a manual assessment process, many articles remain unassessed. We review existing methods for automatically measuring the quality of Wikipedia articles, identifying and comparing machine learning algorithms, article features, quality metrics, and used datasets, examining 149 distinct studies, and exploring commonalities and gaps in them. The literature is extensive, and the approaches follow past technological trends. However, machine learning is still not widely used by Wikipedia, and we hope that our analysis helps future researchers change that reality.


title: Offset coalescence behaviour of impacting low-surface tension droplet on high-surface-tension droplet

abstract: Impact of droplets of varying surface tension and subsequent spreading over a solid surface are inherent features in printing applications. In this regard, an experimental study of impact of two drops of varied surface tension is carried out where the sessile water droplet on a hydrophilic substrate is impacted upon by another droplet of sequentially lowered surface tension. The impacts are studied for different impact velocities and offsets with respect to the mid-plane of the two colliding droplets. Sodium Dodecyl Sulfate (SDS) is used to alter the surface tension without altering the viscosity, to study the various parameters affecting the spreading length viz. the surface tension, offset between the drops, and impact velocity. The spreading lengths are obtained through image processing of the captured footage of the impact dynamics by a high-speed camera. It is found out that upon lowering the surface tension, the maximum and equilibrium spreading length varies to a significant extent also the nature of the spreading dynamics changes. Both side and top-view imaging are performed to understand the overall hydrodynamics. There is also a substantial change in drawback when dissimilarity is surface tension between the impacting droplets exist. Finally, a fit model is obtained to predict the maximum spread length of the various cases.


title: Exploring Model Learning Heterogeneity for Boosting Ensemble Robustness

abstract: Deep neural network ensembles hold the potential of improving generalization performance for complex learning tasks. This paper presents formal analysis and empirical evaluation to show that heterogeneous deep ensembles with high ensemble diversity can effectively leverage model learning heterogeneity to boost ensemble robustness. We first show that heterogeneous DNN models trained for solving the same learning problem, e.g., object detection, can significantly strengthen the mean average precision (mAP) through our weighted bounding box ensemble consensus method. Second, we further compose ensembles of heterogeneous models for solving different learning problems, e.g., object detection and semantic segmentation, by introducing the connected component labeling (CCL) based alignment. We show that this two-tier heterogeneity driven ensemble construction method can compose an ensemble team that promotes high ensemble diversity and low negative correlation among member models of the ensemble, strengthening ensemble robustness against both negative examples and adversarial attacks. Third, we provide a formal analysis of the ensemble robustness in terms of negative correlation. Extensive experiments validate the enhanced robustness of heterogeneous ensembles in both benign and adversarial settings. The source codes are available on GitHub at https://github.com/git-disl/HeteRobust.


title: Who's Harry Potter? Approximate Unlearning in LLMs

abstract: Large language models (LLMs) are trained on massive internet corpora that often contain copyrighted content. This poses legal and ethical challenges for the developers and users of these models, as well as the original authors and publishers. In this paper, we propose a novel technique for unlearning a subset of the training data from a LLM, without having to retrain it from scratch. We evaluate our technique on the task of unlearning the Harry Potter books from the Llama2-7b model (a generative language model recently open-sourced by Meta). While the model took over 184K GPU-hours to pretrain, we show that in about 1 GPU hour of finetuning, we effectively erase the model's ability to generate or recall Harry Potter-related content, while its performance on common benchmarks (such as Winogrande, Hellaswag, arc, boolq and piqa) remains almost unaffected. We make our fine-tuned model publicly available on HuggingFace for community evaluation. To the best of our knowledge, this is the first paper to present an effective technique for unlearning in generative language models. Our technique consists of three main components: First, we use a reinforced model that is further trained on the target data to identify the tokens that are most related to the unlearning target, by comparing its logits with those of a baseline model. Second, we replace idiosyncratic expressions in the target data with generic counterparts, and leverage the model's own predictions to generate alternative labels for every token. These labels aim to approximate the next-token predictions of a model that has not been trained on the target data. Third, we finetune the model on these alternative labels, which effectively erases the original text from the model's memory whenever it is prompted with its context.


title: MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens

abstract: The effectiveness of Multimodal Large Language Models (MLLMs) demonstrates a profound capability in multimodal understanding. However, the simultaneous generation of images with coherent texts is still underdeveloped. Addressing this, we introduce a novel interleaved vision-and-language generation method, centered around the concept of ``generative vokens". These vokens serve as pivotal elements contributing to coherent image-text outputs. Our method is marked by a unique two-stage training strategy for description-free multimodal generation, which does not necessitate extensive descriptions of images. We integrate classifier-free guidance to enhance the alignment of generated images and texts, ensuring more seamless and contextually relevant multimodal interactions. Our model, MiniGPT-5, exhibits substantial improvement over the baseline models on multimodal generation datasets, including MMDialog and VIST. The human evaluation shows MiniGPT-5 is better than the baseline model on more than 56\% cases for multimodal generation, highlighting its efficacy across diverse benchmarks.


title: Spherical Rolling Robots Design, Modeling, and Control: A Systematic Literature Review

abstract: Spherical robots have garnered increasing interest for their applications in exploration, tunnel inspection, and extraterrestrial missions. Diverse designs have emerged, including barycentric configurations, pendulum-based mechanisms, etc. In addition, a wide spectrum of control strategies has been proposed, ranging from traditional PID approaches to cutting-edge neural networks. Our systematic review aims to comprehensively identify and categorize locomotion systems and control schemes employed by spherical robots, spanning the years 1996 to 2023. A meticulous search across five databases yielded a dataset of 3189 records. As a result of our exhaustive analysis, we identified a collection of novel designs and control strategies. Leveraging the insights garnered, we provide valuable recommendations for optimizing the design and control aspects of spherical robots, supporting both novel design endeavors and the advancement of field deployments. Furthermore, we illuminate key research directions that hold the potential to unlock the full capabilities of spherical robots


title: High Angular Resolution Imaging of the V892 Tau Binary System: A New Circumprimary Disk Detection and Updated Orbital Constraints

abstract: We present a direct imaging study of V892 Tau, a young Herbig Ae/Be star with a close-in stellar companion and circumbinary disk. Our observations consist of images acquired via Keck 2/NIRC2 with non-redundant masking and the pyramid wavefront sensor at K$^\prime$ band (2.12$\mu$m) and L$^\prime$ band (3.78$\mu$m). Sensitivity to low-mass accreting companions and cool disk material is high at L$^\prime$ band, while complimentary observations at K$^\prime$ band probe hotter material with higher angular resolution. These multi-wavelength, multi-epoch data allow us to differentiate the secondary stellar emission from disk emission and deeply probe the structure of the circumbinary disk at small angular separations. We constrain architectural properties of the system by fitting geometric disk and companion models to the K$^\prime$ and L$^\prime$ band data. From these models, we constrain the astrometric and photometric properties of the stellar binary and update the orbit, placing the tightest estimates to date on the V892 Tau orbital parameters. We also constrain the geometric structure of the circumbinary disk, and resolve a circumprimary disk for the first time.


title: Hierarchical Generation of Human-Object Interactions with Diffusion Probabilistic Models

abstract: This paper presents a novel approach to generating the 3D motion of a human interacting with a target object, with a focus on solving the challenge of synthesizing long-range and diverse motions, which could not be fulfilled by existing auto-regressive models or path planning-based methods. We propose a hierarchical generation framework to solve this challenge. Specifically, our framework first generates a set of milestones and then synthesizes the motion along them. Therefore, the long-range motion generation could be reduced to synthesizing several short motion sequences guided by milestones. The experiments on the NSM, COUCH, and SAMP datasets show that our approach outperforms previous methods by a large margin in both quality and diversity. The source code is available on our project page https://zju3dv.github.io/hghoi.


title: Learning quantum Hamiltonians at any temperature in polynomial time

abstract: We study the problem of learning a local quantum Hamiltonian $H$ given copies of its Gibbs state $\rho = e^{-\beta H}/\textrm{tr}(e^{-\beta H})$ at a known inverse temperature $\beta>0$. Anshu, Arunachalam, Kuwahara, and Soleimanifar (arXiv:2004.07266) gave an algorithm to learn a Hamiltonian on $n$ qubits to precision $\epsilon$ with only polynomially many copies of the Gibbs state, but which takes exponential time. Obtaining a computationally efficient algorithm has been a major open problem [Alhambra'22 (arXiv:2204.08349)], [Anshu, Arunachalam'22 (arXiv:2204.08349)], with prior work only resolving this in the limited cases of high temperature [Haah, Kothari, Tang'21 (arXiv:2108.04842)] or commuting terms [Anshu, Arunachalam, Kuwahara, Soleimanifar'21]. We fully resolve this problem, giving a polynomial time algorithm for learning $H$ to precision $\epsilon$ from polynomially many copies of the Gibbs state at any constant $\beta > 0$. Our main technical contribution is a new flat polynomial approximation to the exponential function, and a translation between multi-variate scalar polynomials and nested commutators. This enables us to formulate Hamiltonian learning as a polynomial system. We then show that solving a low-degree sum-of-squares relaxation of this polynomial system suffices to accurately learn the Hamiltonian.


title: Tensor Programs VI: Feature Learning in Infinite-Depth Neural Networks

abstract: By classifying infinite-width neural networks and identifying the *optimal* limit, Tensor Programs IV and V demonstrated a universal way, called $\mu$P, for *widthwise hyperparameter transfer*, i.e., predicting optimal hyperparameters of wide neural networks from narrow ones. Here we investigate the analogous classification for *depthwise parametrizations* of deep residual networks (resnets). We classify depthwise parametrizations of block multiplier and learning rate by their infinite-width-then-depth limits. In resnets where each block has only one layer, we identify a unique optimal parametrization, called Depth-$\mu$P that extends $\mu$P and show empirically it admits depthwise hyperparameter transfer. We identify *feature diversity* as a crucial factor in deep networks, and Depth-$\mu$P can be characterized as maximizing both feature learning and feature diversity. Exploiting this, we find that absolute value, among all homogeneous nonlinearities, maximizes feature diversity and indeed empirically leads to significantly better performance. However, if each block is deeper (such as modern transformers), then we find fundamental limitations in all possible infinite-depth limits of such parametrizations, which we illustrate both theoretically and empirically on simple networks as well as Megatron transformer trained on Common Crawl.


title: Reheating formulas in Quintessential Inflation via Gravitational Particle Production

abstract: We calculate the reheating temperature in scenarios where heavy particles are gravitationally produced during a phase transition. We explore two distinct situations: the decay of these particles both during and after the kination phase. Subsequently, we determine the respective reheating temperatures. Finally, we constrain these temperatures based on considerations related to the overproduction of Gravitational Waves during the phase transition from the end of inflation to the onset of kination.


title: Learning to Relax: Setting Solver Parameters Across a Sequence of Linear System Instances

abstract: Solving a linear system $Ax=b$ is a fundamental scientific computing primitive for which numerous solvers and preconditioners have been developed. These come with parameters whose optimal values depend on the system being solved and are often impossible or too expensive to identify; thus in practice sub-optimal heuristics are used. We consider the common setting in which many related linear systems need to be solved, e.g. during a single numerical simulation. In this scenario, can we sequentially choose parameters that attain a near-optimal overall number of iterations, without extra matrix computations? We answer in the affirmative for Successive Over-Relaxation (SOR), a standard solver whose parameter $\omega$ has a strong impact on its runtime. For this method, we prove that a bandit online learning algorithm--using only the number of iterations as feedback--can select parameters for a sequence of instances such that the overall cost approaches that of the best fixed $\omega$ as the sequence length increases. Furthermore, when given additional structural information, we show that a contextual bandit method asymptotically achieves the performance of the instance-optimal policy, which selects the best $\omega$ for each instance. Our work provides the first learning-theoretic treatment of high-precision linear system solvers and the first end-to-end guarantees for data-driven scientific computing, demonstrating theoretically the potential to speed up numerical methods using well-understood learning algorithms.


title: Efficient Enumeration of Drawings and Combinatorial Structures for Maximal Planar Graphs

abstract: We propose efficient algorithms for enumerating the notorious combinatorial structures of maximal planar graphs, called canonical orderings and Schnyder woods, and the related classical graph drawings by de Fraysseix, Pach, and Pollack [Combinatorica, 1990] and by Schnyder [SODA, 1990], called canonical drawings and Schnyder drawings, respectively. To this aim (i) we devise an algorithm for enumerating special $e$-bipolar orientations of maximal planar graphs, called canonical orientations; (ii) we establish bijections between canonical orientations and canonical drawings, and between canonical orientations and Schnyder drawings; and (iii) we exploit the known correspondence between canonical orientations and canonical orderings, and the known bijection between canonical orientations and Schnyder woods. All our enumeration algorithms have $O(n)$ setup time, space usage, and delay between any two consecutively listed outputs, for an $n$-vertex maximal planar graph.


title: Variational Coherent Quantum Annealing

abstract: We present a hybrid classical-quantum computing paradigm where the quantum part strictly runs within the coherence time of a quantum annealer, a method we call variational coherent quantum annealing (VCQA). It involves optimizing the schedule functions governing the quantum dynamics by employing a piecewise family of tailored functions. We also introduce auxiliary Hamiltonians that vanish at the beginning and end of the evolution to increase the energy gap during the process, subsequently reducing the algorithm times. We develop numerical tests using z-local terms as the auxiliary Hamiltonian while considering linear, cyclic, and star connectivity. Moreover, we test our algorithm for a non-stoquastic Hamiltonian such as a Heisenberg chain, showing the potential of the VCQA proposal in different scenarios. In this manner, we achieve a substantial reduction in the ground-state error with just six variational parameters and a duration within the device coherence times. Therefore, the proposed VCQA paradigm offers exciting prospects for current quantum annealers.


title: Harnessing Pre-Trained Sentence Transformers for Offensive Language Detection in Indian Languages

abstract: In our increasingly interconnected digital world, social media platforms have emerged as powerful channels for the dissemination of hate speech and offensive content. This work delves into the domain of hate speech detection, placing specific emphasis on three low-resource Indian languages: Bengali, Assamese, and Gujarati. The challenge is framed as a text classification task, aimed at discerning whether a tweet contains offensive or non-offensive content. Leveraging the HASOC 2023 datasets, we fine-tuned pre-trained BERT and SBERT models to evaluate their effectiveness in identifying hate speech. Our findings underscore the superiority of monolingual sentence-BERT models, particularly in the Bengali language, where we achieved the highest ranking. However, the performance in Assamese and Gujarati languages signifies ongoing opportunities for enhancement. Our goal is to foster inclusive online spaces by countering hate speech proliferation.


title: Why should autoencoders work?

abstract: Deep neural network autoencoders are routinely used computationally for model reduction. They allow recognizing the intrinsic dimension of data that lie in a $k$-dimensional subset $K$ of an input Euclidean space $\mathbb{R}^n$. The underlying idea is to obtain both an encoding layer that maps $\mathbb{R}^n$ into $\mathbb{R}^k$ (called the bottleneck layer or the space of latent variables) and a decoding layer that maps $\mathbb{R}^k$ back into $\mathbb{R}^n$, in such a way that the input data from the set $K$ is recovered when composing the two maps. This is achieved by adjusting parameters (weights) in the network to minimize the discrepancy between the input and the reconstructed output. Since neural networks (with continuous activation functions) compute continuous maps, the existence of a network that achieves perfect reconstruction would imply that $K$ is homeomorphic to a $k$-dimensional subset of $\mathbb{R}^k$, so clearly there are topological obstructions to finding such a network. On the other hand, in practice the technique is found to "work" well, which leads one to ask if there is a way to explain this effectiveness. We show that, up to small errors, indeed the method is guaranteed to work. This is done by appealing to certain facts from differential topology. A computational example is also included to illustrate the ideas.


title: Talk2BEV: Language-enhanced Bird's-eye View Maps for Autonomous Driving

abstract: Talk2BEV is a large vision-language model (LVLM) interface for bird's-eye view (BEV) maps in autonomous driving contexts. While existing perception systems for autonomous driving scenarios have largely focused on a pre-defined (closed) set of object categories and driving scenarios, Talk2BEV blends recent advances in general-purpose language and vision models with BEV-structured map representations, eliminating the need for task-specific models. This enables a single system to cater to a variety of autonomous driving tasks encompassing visual and spatial reasoning, predicting the intents of traffic actors, and decision-making based on visual cues. We extensively evaluate Talk2BEV on a large number of scene understanding tasks that rely on both the ability to interpret free-form natural language queries, and in grounding these queries to the visual context embedded into the language-enhanced BEV map. To enable further research in LVLMs for autonomous driving scenarios, we develop and release Talk2BEV-Bench, a benchmark encompassing 1000 human-annotated BEV scenarios, with more than 20,000 questions and ground-truth responses from the NuScenes dataset.


title: Gelfand-Tsetlin basis for partially transposed permutations, with applications to quantum information

abstract: We study representation theory of the partially transposed permutation matrix algebra, a matrix representation of the diagrammatic walled Brauer algebra. This algebra plays a prominent role in mixed Schur-Weyl duality that appears in various contexts in quantum information. Our main technical result is an explicit formula for the action of the walled Brauer algebra generators in the Gelfand-Tsetlin basis. It generalizes the well-known Gelfand-Tsetlin basis for the symmetric group (also known as Young's orthogonal form or Young-Yamanouchi basis). We provide two applications of our result to quantum information. First, we show how to simplify semidefinite optimization problems over unitary-equivariant quantum channels by performing a symmetry reduction. Second, we derive an efficient quantum circuit for implementing the optimal port-based quantum teleportation protocol, exponentially improving the known trivial construction. As a consequence, this also exponentially improves the known lower bound for the amount of entanglement needed to implement unitaries non-locally. Both applications require a generalization of quantum Schur transform to tensors of mixed unitary symmetry. We develop an efficient quantum circuit for this mixed quantum Schur transform and provide a matrix product state representation of its basis vectors. For constant local dimension, this yields an efficient classical algorithm for computing any entry of the mixed quantum Schur transform unitary.


title: Estimating Digital Product Trade through Corporate Revenue Data

abstract: Despite global efforts to harmonize international trade statistics, our understanding of digital trade and its implications remains limited. Here, we introduce a method to estimate bilateral exports and imports for dozens of sectors starting from the corporate revenue data of large digital firms. This method allows us to provide estimates for digitally ordered and delivered trade involving digital goods (e.g. video games), productized services (e.g. digital advertising), and digital intermediation fees (e.g. hotel rental), which together we call digital products. We use these estimates to study five key aspects of digital trade. We find that, compared to trade in physical goods, digital product exports are more spatially concentrated, have been growing faster, and can offset trade balance estimates, like the United States trade deficit on physical goods. We also find that countries that have decoupled economic growth from greenhouse gas emissions tend to have larger digital exports and that digital products exports contribute positively to the complexity of economies. This method, dataset, and findings provide a new lens to understand the impact of international trade in digital products.


title: Learning unitaries with quantum statistical queries

abstract: We propose several algorithms for learning unitary operators from quantum statistical queries (QSQs) with respect to their Choi-Jamiolkowski state. Quantum statistical queries capture the capabilities of a learner with limited quantum resources, which receives as input only noisy estimates of expected values of measurements. Our methods hinge on a novel technique for estimating the Fourier mass of a unitary on a subset of Pauli strings with a single quantum statistical query, generalizing a previous result for uniform quantum examples. Exploiting this insight, we show that the quantum Goldreich-Levin algorithm can be implemented with quantum statistical queries, whereas the prior version of the algorithm involves oracle access to the unitary and its inverse. Moreover, we prove that $\mathcal{O}(\log n)$-juntas and quantum Boolean functions with constant total influence are efficiently learnable in our model, and constant-depth circuits are learnable sample-efficiently with quantum statistical queries. On the other hand, all previous algorithms for these tasks require direct access to the Choi-Jamiolkowski state or oracle access to the unitary. In addition, our upper bounds imply that the actions of those classes of unitaries on locally scrambled ensembles can be efficiently learned. We also demonstrate that, despite these positive results, quantum statistical queries lead to an exponentially larger sample complexity for certain tasks, compared to separable measurements to the Choi-Jamiolkowski state. In particular, we show an exponential lower bound for learning a class of phase-oracle unitaries and a double exponential lower bound for testing the unitarity of channels, adapting to our setting previous arguments for quantum states. Finally, we propose a new definition of average-case surrogate models, showing a potential application of our results to hybrid quantum machine learning.


title: MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts

abstract: Large Language Models (LLMs) and Large Multimodal Models (LMMs) exhibit impressive problem-solving skills in many tasks and domains, but their ability in mathematical reasoning in visual contexts has not been systematically studied. To bridge this gap, we present MathVista, a benchmark designed to combine challenges from diverse mathematical and visual tasks. It consists of 6,141 examples, derived from 28 existing multimodal datasets involving mathematics and 3 newly created datasets (i.e., IQTest, FunctionQA, and PaperQA). Completing these tasks requires fine-grained, deep visual understanding and compositional reasoning, which all state-of-the-art foundation models find challenging. With MathVista, we have conducted a comprehensive, quantitative evaluation of 12 prominent foundation models. The best-performing GPT-4V model achieves an overall accuracy of 49.9%, substantially outperforming Bard, the second-best performer, by 15.1%. Our in-depth analysis reveals that the superiority of GPT-4V is mainly attributed to its enhanced visual perception and mathematical reasoning. However, GPT-4V still falls short of human performance by 10.4%, as it often struggles to understand complex figures and perform rigorous reasoning. This significant gap underscores the critical role that MathVista will play in the development of general-purpose AI agents capable of tackling mathematically intensive and visually rich real-world tasks. We further explore the new ability of self-verification, the application of self-consistency, and the interactive chatbot capabilities of GPT-4V, highlighting its promising potential for future research. The project is available at https://mathvista.github.io/.


title: Detecting New Visual Binaries in Gaia DR3 with Gaia and 2MASS Photometry I. New Candidate Binaries Within 200 pc of the Sun

abstract: We present a method to identify likely visual binaries in Gaia eDR3 that does not rely on parallax or proper motion. This method utilizes the various PSF sizes of 2MASS/Gaia, where at $<2.5$" two stars may be unresolved in 2MASS but resolved by Gaia. Due to this, if close neighbors listed in Gaia are a resolved pair, the associated 2MASS source will have a predictable excess in the J-band that depends on the $\Delta G$ of the pair. We demonstrate that the expected relationship between 2MASS excess and $\Delta G$ differs for chance alignments, as compared to true binary systems, when parameters like magnitude and location on the sky are also considered. Using these multidimensional distributions, we compute the likelihood of a close pair of stars to be a chance alignment, resulting in a total(clean) catalog of 68,725(50,230) likely binaries within 200 pc with a completeness rate of $\sim75\%$($\sim64\%$) and contamination rate of $\sim14\%$($\sim0.4\%$). Within this, we find 590 previously unidentified binaries from Gaia eDR3 with projected physical separations $<30$ AU, where 138 systems were previously identified, and for $s<10$ AU we find that 4 out of 15 new likely binaries have not yet been observed with high-resolution imaging. We also demonstrate the potential of our catalog to determine physical separation distributions and binary fraction estimates, from this increase in low separation binaries. Overall, this catalog provides a good complement for the study of local binary populations by probing smaller physical separations and mass ratios, and provides prime targets for speckle monitoring.


title: Local Volume Concentration, Packing Domains and Scaling Properties of Chromatin

abstract: We propose the Self Returning Excluded Volume (SR-EV) model for the structure of chromatin based on stochastic rules and physical interactions. The SR-EV rules of return generate conformationally-defined domains observed by single cell imaging techniques. From nucleosome to chromosome scales, the model captures the overall chromatin organization as a corrugated system, with dense and dilute regions alternating in a manner that resembles the mixing of two disordered bi-continuous phases. This particular organizational topology is a consequence of the multiplicity of interactions and processes occurring in the nuclei, and mimicked by the proposed return rules. Single configuration properties and ensemble averages show a robust agreement between theoretical and experimental results including chromatin volume concentration, contact probability, packing domain identification and size characterization, and packing scaling behavior. Model and experimental results suggest that there is an inherent chromatin organization regardless of the cell character and resistant to an external forcing such as Rad21 degradation.


title: A Neural Scaling Law from Lottery Ticket Ensembling

abstract: Neural scaling laws (NSL) refer to the phenomenon where model performance improves with scale. Sharma & Kaplan analyzed NSL using approximation theory and predict that MSE losses decay as $N^{-\alpha}$, $\alpha=4/d$, where $N$ is the number of model parameters, and $d$ is the intrinsic input dimension. Although their theory works well for some cases (e.g., ReLU networks), we surprisingly find that a simple 1D problem $y=x^2$ manifests a different scaling law ($\alpha=1$) from their predictions ($\alpha=4$). We opened the neural networks and found that the new scaling law originates from lottery ticket ensembling: a wider network on average has more "lottery tickets", which are ensembled to reduce the variance of outputs. We support the ensembling mechanism by mechanistically interpreting single neural networks, as well as studying them statistically. We attribute the $N^{-1}$ scaling law to the "central limit theorem" of lottery tickets. Finally, we discuss its potential implications for large language models and statistical physics-type theories of learning.


title: Towards An Analytical Framework for Potential Games

abstract: Potential game is an emerging notion and framework for studying multi-agent games, especially with heterogeneous agents. Up to date, potential games have been extensively studied mostly from the algorithmic aspect in approximating and computing the Nash equilibrium without verifying if the game is a potential game, due to the lack of analytical structure. In this paper, we aim to build an analytical framework for dynamic potential games. We prove that a game is a potential game if and only if each agent's value function can be decomposed as a potential function and a residual term that solely dependent on other agents' actions. This decomposition enables us to identify and analyze a new and important class of potential games called the distributed game. Moreover, by an appropriate notion of functional derivatives, we prove that a game is a potential game if the value function has a symmetric Jacobian. Consequently, for a general class of continuous-time stochastic games, their potential functions can be further characterized from both the probabilistic and the PDE approaches. The consistency of these two characterisations are shown in a class of linear-quadratic games.


title: TransRadar: Adaptive-Directional Transformer for Real-Time Multi-View Radar Semantic Segmentation

abstract: Scene understanding plays an essential role in enabling autonomous driving and maintaining high standards of performance and safety. To address this task, cameras and laser scanners (LiDARs) have been the most commonly used sensors, with radars being less popular. Despite that, radars remain low-cost, information-dense, and fast-sensing techniques that are resistant to adverse weather conditions. While multiple works have been previously presented for radar-based scene semantic segmentation, the nature of the radar data still poses a challenge due to the inherent noise and sparsity, as well as the disproportionate foreground and background. In this work, we propose a novel approach to the semantic segmentation of radar scenes using a multi-input fusion of radar data through a novel architecture and loss functions that are tailored to tackle the drawbacks of radar perception. Our novel architecture includes an efficient attention block that adaptively captures important feature information. Our method, TransRadar, outperforms state-of-the-art methods on the CARRADA and RADIal datasets while having smaller model sizes. https://github.com/YahiDar/TransRadar


title: Adaptive Online Non-stochastic Control

abstract: We tackle the problem of Non-stochastic Control (NSC) with the aim of obtaining algorithms whose policy regret is proportional to the difficulty of the controlled environment. Namely, we tailor the Follow The Regularized Leader (FTRL) framework to dynamical systems by using regularizers that are proportional to the actual witnessed costs. The main challenge arises from using the proposed adaptive regularizers in the presence of a state, or equivalently, a memory, which couples the effect of the online decisions and requires new tools for bounding the regret. Via new analysis techniques for NSC and FTRL integration, we obtain novel disturbance action controllers (DAC) with sub-linear data adaptive policy regret bounds that shrink when the trajectory of costs has small gradients, while staying sub-linear even in the worst case.


title: RSRD: A Road Surface Reconstruction Dataset and Benchmark for Safe and Comfortable Autonomous Driving

abstract: This paper addresses the growing demands for safety and comfort in intelligent robot systems, particularly autonomous vehicles, where road conditions play a pivotal role in overall driving performance. For example, reconstructing road surfaces helps to enhance the analysis and prediction of vehicle responses for motion planning and control systems. We introduce the Road Surface Reconstruction Dataset (RSRD), a real-world, high-resolution, and high-precision dataset collected with a specialized platform in diverse driving conditions. It covers common road types containing approximately 16,000 pairs of stereo images, original point clouds, and ground-truth depth/disparity maps, with accurate post-processing pipelines to ensure its quality. Based on RSRD, we further build a comprehensive benchmark for recovering road profiles through depth estimation and stereo matching. Preliminary evaluations with various state-of-the-art methods reveal the effectiveness of our dataset and the challenge of the task, underscoring substantial opportunities of RSRD as a valuable resource for advancing techniques, e.g., multi-view stereo towards safe autonomous driving. The dataset and demo videos are available at https://thu-rsxd.com/rsrd/


title: Automatic Pair Construction for Contrastive Post-training

abstract: Alignment serves as an important step to steer large language models (LLMs) towards human preferences. In this paper, we propose an automatic way to construct contrastive data for LLM, using preference pairs from multiple models of varying strengths (e.g., InstructGPT, ChatGPT and GPT-4). We compare the contrastive techniques of SLiC and DPO to SFT baselines and find that DPO provides a step-function improvement even after continuing SFT saturates. We also explore a data curriculum learning scheme for contrastive post-training, which starts by learning from "easier" pairs and transitioning to "harder" ones, which further improves alignment. Finally, we scale up our experiments to train with more data and larger models like Orca. Remarkably, our automatic contrastive post-training further improves the performance of Orca, already a state-of-the-art instruction learning model tuned with GPT-4 outputs, to outperform ChatGPT.


title: Generalizable Long-Horizon Manipulations with Large Language Models

abstract: This work introduces a framework harnessing the capabilities of Large Language Models (LLMs) to generate primitive task conditions for generalizable long-horizon manipulations with novel objects and unseen tasks. These task conditions serve as guides for the generation and adjustment of Dynamic Movement Primitives (DMP) trajectories for long-horizon task execution. We further create a challenging robotic manipulation task suite based on Pybullet for long-horizon task evaluation. Extensive experiments in both simulated and real-world environments demonstrate the effectiveness of our framework on both familiar tasks involving new objects and novel but related tasks, highlighting the potential of LLMs in enhancing robotic system versatility and adaptability. Project website: https://object814.github.io/Task-Condition-With-LLM/


title: DREAM: Visual Decoding from Reversing Human Visual System

abstract: In this work we present DREAM, an fMRI-to-image method for reconstructing viewed images from brain activities, grounded on fundamental knowledge of the human visual system. We craft reverse pathways that emulate the hierarchical and parallel nature of how humans perceive the visual world. These tailored pathways are specialized to decipher semantics, color, and depth cues from fMRI data, mirroring the forward pathways from visual stimuli to fMRI recordings. To do so, two components mimic the inverse processes within the human visual system: the Reverse Visual Association Cortex (R-VAC) which reverses pathways of this brain region, extracting semantics from fMRI data; the Reverse Parallel PKM (R-PKM) component simultaneously predicting color and depth from fMRI signals. The experiments indicate that our method outperforms the current state-of-the-art models in terms of the consistency of appearance, structure, and semantics. Code will be made publicly available to facilitate further research in this field.


title: Hydrodynamics of countercurrent flows in a structured packed column: effects of initial wetting and dynamic contact angle

abstract: Computational countercurrent flow investigation in the structured packed column is a multiscale problem. Multiphase flow studies using volume of fluid (VOF) method in the representative elementary unit (REU) of the packed column can insight into the local hydrodynamics such as interfacial area, film thickness, etc. The interfacial area dictates the mass transfer in absorption process and thereby overall efficiency of column. Impacts of solvent's physical properties, liquid loads and static contact angle (SCA) on the interfacial area were examined earlier. In the present study, the dynamic contact angle (DCA) was used to explore the impact of contact angle hysteresis on the interfacial area. DCA has more pronounced impact on the interfacial area (10%) for aqueous solvent of 0.10M Sodium hydroxide (NaOH). The interfacial area shows undulation and does not achieve the pseudo-steady state. In contrary, the interfacial area gets a net pseudo-steady value for the aqueous solvent having 40% monoethanolamine (MEA) by weight. The wetting hysteresis was also explored via simulations conducted with initially dry and wetted sheets. For 0.10M NaOH aqueous solvent, the initially wetted sheets lead to slightly higher value of the interfacial area (10%) as compared to the initially dry sheets at the same liquid load and DCA. As expected, wetting hysteresis reduces with increasing liquid loads. On the other hand, wetting hysteresis is not significant for 40% MEA aqueous solvent which might be lower surface tension and higher viscosity. Overall, the effect of the dynamic contact angle is not pronounced as compared to those found in a flat surface.


title: A flat FLRW dark energy model in f(Q,C)-gravity theory with observational constraints

abstract: In the recently suggested modified non-metricity gravity theory with boundary terms in a flat FLRWspacetime universe, dark energy scenarios of cosmological models are examined in this study. An arbitrary function, $f(Q, C)=Q+{\alpha}C^{2}$, has been taken into consideration, where Q is the non-metricity scalar, C is the boundary term denoted by $C = R-Q$, and ${\alpha}$ is the model parameter, for the action that is quadratic in C. The Hubble function $H(z) = H0[c_{1} (1+z)^{n}+c_{2}]^{1/2}$, where H0 is the current value of the Hubble constant and n c, and $c_{2}$ are arbitrary parameters with $c_{1}+c_{2}= 1$, has been used to examine the dark energy characteristics of the model. We discovered a transit phase expanding universe model that is both decelerated in the past and accelerated in the present, and we discovered that the dark energy equation of state (EoS) $(\omega^{de})$ behaves as $(-1\leq \omega^{de}<2)$. The $O_{m}$ diagnostic analysis reveals the quintessence behavior in the present and the cosmological constant scenario in the late-time universe. Finally, we calculated the universe's current age, which was found to be quite similar to recent data.


title: Dual Dictionaries in Linear Programming

abstract: In order to use the Dual Simplex Method, one needs to prove a certain bijection between the dictionaries associated with the primal problem and those associated with its dual. We give a short conceptual proof of why this bijection exists.


title: ARRQP: Anomaly Resilient Real-time QoS Prediction Framework with Graph Convolution

abstract: In the realm of modern service-oriented architecture, ensuring Quality of Service (QoS) is of paramount importance. The ability to predict QoS values in advance empowers users to make informed decisions. However, achieving accurate QoS predictions in the presence of various issues and anomalies, including outliers, data sparsity, grey-sheep instances, and cold-start scenarios, remains a challenge. Current state-of-the-art methods often fall short when addressing these issues simultaneously, resulting in performance degradation. In this paper, we introduce a real-time QoS prediction framework (called ARRQP) with a specific emphasis on improving resilience to anomalies in the data. ARRQP utilizes the power of graph convolution techniques to capture intricate relationships and dependencies among users and services, even when the data is limited or sparse. ARRQP integrates both contextual information and collaborative insights, enabling a comprehensive understanding of user-service interactions. By utilizing robust loss functions, ARRQP effectively reduces the impact of outliers during the model training. Additionally, we introduce a sparsity-resilient grey-sheep detection method, which is subsequently treated separately for QoS prediction. Furthermore, we address the cold-start problem by emphasizing contextual features over collaborative features. Experimental results on the benchmark WS-DREAM dataset demonstrate the framework's effectiveness in achieving accurate and timely QoS predictions.


title: Comparative Evaluation of Transfer Learning for Classification of Brain Tumor Using MRI

abstract: Abnormal growth of cells in the brain and its surrounding tissues is known as a brain tumor. There are two types, one is benign (non-cancerous) and another is malignant (cancerous) which may cause death. The radiologists' ability to diagnose malignancies is greatly aided by magnetic resonance imaging (MRI). Brain cancer diagnosis has been considerably expedited by the field of computer-assisted diagnostics, especially in machine learning and deep learning. In our study, we categorize three different kinds of brain tumors using four transfer learning techniques. Our models were tested on a benchmark dataset of $3064$ MRI pictures representing three different forms of brain cancer. Notably, ResNet-50 outperformed other models with a remarkable accuracy of $99.06\%$. We stress the significance of a balanced dataset for improving accuracy without the use of augmentation methods. Additionally, we experimentally demonstrate our method and compare with other classification algorithms on the CE-MRI dataset using evaluations like F1-score, AUC, precision and recall.


title: On long waves and solitons in particle lattices with forces of infinite range

abstract: We study waves on infinite one-dimensional lattices of particles that each interact with all others through power-law forces $F \sim r^{-\beta}$. The inverse-cube case corresponds to Calogero-Moser systems, which are well known to be completely integrable for any finite number of particles. The formal long-wave limit for unidirectional waves in these lattices is the Korteweg-de Vries equation if $\beta >4$, but with $2<\beta <4$ it is a nonlocal dispersive PDE that reduces to the Benjamin-Ono equation for $\beta=3$. For the infinite Calogero-Moser lattice, we find explicit formulas that describe solitary and periodic traveling waves.


title: Final models: A finalistic interpretation of statistical correlation

abstract: This paper aims to extend the framework of causal modelling to teleological explanations. It conceives final models as second-order models produced by interventions on first-order causal models. It shows why such formalisation permits us to realise a finalistic interpretation of statistical correlation which is compatible with its usual causal interpretation. Initially, the paper identifies some conceptual conditions for statistical teleological analysis, specifically involving interventions. Then, it describes an explanation procedure for action and presents one simple example of identifiable final models. Finally, it compares these results with what could be obtained within a purely causalist framework.


title: A New measure of income inequality

abstract: A new measure of income inequality that captures the heavy tail behavior of the income distribution is proposed. We discuss two different approaches to find the estimators of the proposed measure. We show that these estimators are consistent and have an asymptotically normal distribution. A simulation result is presented to evaluate the finite sample properties of the estimators. Finally, we use our measure to study the income inequality of three states in India.


title: Quantum Scalar Field Theory Based On Principle of Least Observability

abstract: Recently it is shown that the non-relativistic quantum formulations can be derived from a least observability principle [36]. In this paper, we apply the principle to massive scalar fields, and derive the Schr\"{o}dinger equation of the wave functional for the scalar fields. The principle extends the least action principle in classical field theory by factoring in two assumptions. First, the Planck constant defines the minimal amount of action a field needs to exhibit in order to be observable. Second, there are constant random field fluctuations. A novel method is introduced to define the information metrics to measure additional observable information due to the field fluctuations, \added{which is then converted to the additional action through the first assumption.} Applying the variation principle to minimize the total actions allows us to elegantly derive the transition probability of field fluctuations, the uncertainty relation, and the Schr\"{o}dinger equation of the wave functional. Furthermore, by defining the information metrics for field fluctuations using general definitions of relative entropy, we obtain a generalized Schr\"{o}dinger equation of the wave functional that depends on the order of relative entropy. Our results demonstrate that the extended least action principle can be applied to derive both non-relativistic quantum mechanics and relativistic quantum scalar field theory. We expect it can be further used to obtain quantum theory for non-scalar fields.


title: MuSe-GNN: Learning Unified Gene Representation From Multimodal Biological Graph Data

abstract: Discovering genes with similar functions across diverse biomedical contexts poses a significant challenge in gene representation learning due to data heterogeneity. In this study, we resolve this problem by introducing a novel model called Multimodal Similarity Learning Graph Neural Network, which combines Multimodal Machine Learning and Deep Graph Neural Networks to learn gene representations from single-cell sequencing and spatial transcriptomic data. Leveraging 82 training datasets from 10 tissues, three sequencing techniques, and three species, we create informative graph structures for model training and gene representations generation, while incorporating regularization with weighted similarity learning and contrastive learning to learn cross-data gene-gene relationships. This novel design ensures that we can offer gene representations containing functional similarity across different contexts in a joint space. Comprehensive benchmarking analysis shows our model's capacity to effectively capture gene function similarity across multiple modalities, outperforming state-of-the-art methods in gene representation learning by up to 97.5%. Moreover, we employ bioinformatics tools in conjunction with gene representations to uncover pathway enrichment, regulation causal networks, and functions of disease-associated or dosage-sensitive genes. Therefore, our model efficiently produces unified gene representations for the analysis of gene functions, tissue functions, diseases, and species evolution.


title: Deep learning soliton dynamics and complex potentials recognition for 1D and 2D PT-symmetric saturable nonlinear Schr\"odinger equations

abstract: In this paper, we firstly extend the physics-informed neural networks (PINNs) to learn data-driven stationary and non-stationary solitons of 1D and 2D saturable nonlinear Schr\"odinger equations (SNLSEs) with two fundamental PT-symmetric Scarf-II and periodic potentials in optical fibers. Secondly, the data-driven inverse problems are studied for PT-symmetric potential functions discovery rather than just potential parameters in the 1D and 2D SNLSEs. Particularly, we propose a modified PINNs (mPINNs) scheme to identify directly the PT potential functions of the 1D and 2D SNLSEs by the solution data. And the inverse problems about 1D and 2D PT -symmetric potentials depending on propagation distance z are also investigated using mPINNs method. We also identify the potential functions by the PINNs applied to the stationary equation of the SNLSE. Furthermore, two network structures are compared under different parameter conditions such that the predicted PT potentials can achieve the similar high accuracy. These results illustrate that the established deep neural networks can be successfully used in 1D and 2D SNLSEs with high accuracies. Moreover, some main factors affecting neural networks performance are discussed in 1D and 2D PT Scarf-II and periodic potentials, including activation functions, structures of the networks, and sizes of the training data. In particular, twelve different nonlinear activation functions are in detail analyzed containing the periodic and non-periodic functions such that it is concluded that selecting activation functions according to the form of solution and equation usually can achieve better effect.


title: Pruning Small Pre-Trained Weights Irreversibly and Monotonically Impairs "Difficult" Downstream Tasks in LLMs

abstract: We present Junk DNA Hypothesis by adopting a novel task-centric angle for the pre-trained weights of large language models (LLMs). It has been believed that weights in LLMs contain significant redundancy, leading to the conception that a considerable chunk of the parameters can be removed by pruning without compromising performance. Contrary to this belief, this paper presents a counter-argument: small-magnitude weights of pre-trained model weights encode vital knowledge essential for tackling difficult downstream tasks - manifested as the monotonic relationship between the performance drop of downstream tasks across the difficulty spectrum, as we prune more pre-trained weights by magnitude. Moreover, we reveal that these seemingly inconsequential weights can result in irreparable loss of knowledge and performance degradation in difficult tasks, even when downstream continual training is allowed. Interestingly, our evaluations show that the other popular compression, namely quantization, fails to exhibit similar monotonic effect and does not as convincingly disentangle this task-difficulty information. To study formally, we introduce several quantifiable metrics to gauge the downstream task difficulty: (1) within the same task category, and (2) across different task categories. Our extensive experiments substantiate the Junk DNA Hypothesis across a diverse range of model sizes, tasks, datasets, and even pruning methods. Codes are available at: https://github.com/VITA-Group/Junk_DNA_Hypothesis.git.


title: A Stable and Efficient Covariate-Balancing Estimator for Causal Survival Effects

abstract: We propose an empirically stable and asymptotically efficient covariate-balancing approach to the problem of estimating survival causal effects in data with conditionally-independent censoring. This addresses a challenge often encountered in state-of-the-art nonparametric methods: the use of inverses of small estimated probabilities and the resulting amplification of estimation error. We validate our theoretical results in experiments on synthetic and semi-synthetic data.


title: Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusion

abstract: Consistency Models (CM) (Song et al., 2023) accelerate score-based diffusion model sampling at the cost of sample quality but lack a natural way to trade-off quality for speed. To address this limitation, we propose Consistency Trajectory Model (CTM), a generalization encompassing CM and score-based models as special cases. CTM trains a single neural network that can -- in a single forward pass -- output scores (i.e., gradients of log-density) and enables unrestricted traversal between any initial and final time along the Probability Flow Ordinary Differential Equation (ODE) in a diffusion process. CTM enables the efficient combination of adversarial training and denoising score matching loss to enhance performance and achieves new state-of-the-art FIDs for single-step diffusion model sampling on CIFAR-10 (FID 1.73) and ImageNet at 64x64 resolution (FID 1.92). CTM also enables a new family of sampling schemes, both deterministic and stochastic, involving long jumps along the ODE solution trajectories. It consistently improves sample quality as computational budgets increase, avoiding the degradation seen in CM. Furthermore, unlike CM, CTM's access to the score function can streamline the adoption of established controllable/conditional generation methods from the diffusion community. This access also enables the computation of likelihood. The code is available at https://github.com/sony/ctm.


title: Expert enhanced dynamic time warping based anomaly detection

abstract: Dynamic time warping (DTW) is a well-known algorithm for time series elastic dissimilarity measure. Its ability to deal with non-linear time distortions makes it helpful in variety of data mining tasks. Such a task is also anomaly detection which attempts to reveal unexpected behaviour without false detection alarms. In this paper, we propose a novel anomaly detection method named Expert enhanced dynamic time warping anomaly detection (E-DTWA). It is based on DTW with additional enhancements involving human-in-the-loop concept. The main benefits of our approach comprise efficient detection, flexible retraining based on strong consideration of the expert's detection feedback while retaining low computational and space complexity.


title: End-to-End Continuous Speech Emotion Recognition in Real-life Customer Service Call Center Conversations

abstract: Speech Emotion recognition (SER) in call center conversations has emerged as a valuable tool for assessing the quality of interactions between clients and agents. In contrast to controlled laboratory environments, real-life conversations take place under uncontrolled conditions and are subject to contextual factors that influence the expression of emotions. In this paper, we present our approach to constructing a large-scale reallife dataset (CusEmo) for continuous SER in customer service call center conversations. We adopted the dimensional emotion annotation approach to capture the subtlety, complexity, and continuity of emotions in real-life call center conversations, while annotating contextual information. The study also addresses the challenges encountered during the application of the End-to-End (E2E) SER system to the dataset, including determining the appropriate label sampling rate and input segment length, as well as integrating contextual information (interlocutor's gender and empathy level) with different weights using multitask learning. The result shows that incorporating the empathy level information improved the model's performance.


title: SWMLP: Shared Weight Multilayer Perceptron for Car Trajectory Speed Prediction using Road Topographical Features

abstract: Although traffic is one of the massively collected data, it is often only available for specific regions. One concern is that, although there are studies that give good results for these data, the data from these regions may not be sufficiently representative to describe all the traffic patterns in the rest of the world. In quest of addressing this concern, we propose a speed prediction method that is independent of large historical speed data. To predict a vehicle's speed, we use the trajectory road topographical features to fit a Shared Weight Multilayer Perceptron learning model. Our results show significant improvement, both qualitative and quantitative, over standard regression analysis. Moreover, the proposed framework sheds new light on the way to design new approaches for traffic analysis.


title: The magical "Born Rule" & quantum "measurement": Implications for Physics

abstract: I. The arena of quantum mechanics and quantum field theory is the abstract, unobserved and unobservable, M-dimensional formal Hilbert space [not equal to] spacetime. II. The arena of observations and, more generally, of all events (i.e. everything) in the real physical world, is the classical 4-dimensional physical spacetime. III. The "Born Rule" is the random process "magically" transforming I. into II. Wavefunctions are superposed and entangled only in the abstract space I., never in spacetime II. Attempted formulations of quantum theory directly in real physical spacetime actually constitute examples of "locally real" theories, as defined by Clauser & Horne, and are therefore already empirically refuted by the numerous tests of Bell's theorem in real, controlled experiments in laboratories here on Earth. Observed quantum entities, i.e. events, are never superposed or entangled as they: 1) Exclusively "live" (manifest) in real physical spacetime, 2) Are not described by entangled wavefunctions after "measurement", effectuated by III. When separated and treated correctly in this way, a number of fundamental problems and "paradoxes" of quantum theory vs. relativity (i.e. spacetime) simply vanish, such as the black hole information paradox, infinite zero-point energy of quantum field theory and quantization of general relativity.


title: PASTA: PArallel Spatio-Temporal Attention with spatial auto-correlation gating for fine-grained crowd flow prediction

abstract: Understanding the movement patterns of objects (e.g., humans and vehicles) in a city is essential for many applications, including city planning and management. This paper proposes a method for predicting future city-wide crowd flows by modeling the spatio-temporal patterns of historical crowd flows in fine-grained city-wide maps. We introduce a novel neural network named PArallel Spatio-Temporal Attention with spatial auto-correlation gating (PASTA) that effectively captures the irregular spatio-temporal patterns of fine-grained maps. The novel components in our approach include spatial auto-correlation gating, multi-scale residual block, and temporal attention gating module. The spatial auto-correlation gating employs the concept of spatial statistics to identify irregular spatial regions. The multi-scale residual block is responsible for handling multiple range spatial dependencies in the fine-grained map, and the temporal attention gating filters out irrelevant temporal information for the prediction. The experimental results demonstrate that our model outperforms other competing baselines, especially under challenging conditions that contain irregular spatial regions. We also provide a qualitative analysis to derive the critical time information where our model assigns high attention scores in prediction.


title: QED based on eight-dimensional spinorial wave equation of the electromagnetic field and the emergence of quantum gravity

abstract: Quantum electrodynamics (QED) is the most accurate of all experimentally verified physical theories. How QED and other theories of fundamental interactions couple to gravity through special unitary symmetries, on which the standard model of particle physics is based, is, however, still unknown. Here we develop a coupling between the electromagnetic field, Dirac electron-positron field, and the gravitational field based on an eight-component spinorial representation of the electromagnetic field. Our spinorial representation is analogous to the well-known representation of particles in the Dirac theory but it is given in terms of 8x8 bosonic gamma matrices. In distinction from earlier works on the spinorial representations of the electromagnetic field, we reformulate QED using eight-component spinors. This enables us to introduce the generating Lagrangian density of gravity based on the special unitary symmetry of the eight-dimensional spinor space. The generating Lagrangian density of gravity plays, in the definition of the gauge theory of gravity and its symmetric stress-energy-momentum tensor source term, a similar role as the conventional Lagrangian density of the free Dirac field plays in the definition of the gauge theory of QED and its electric four-current density source term. The fundamental consequence, the Yang-Mills gauge theory of unified gravity, is studied in a separate work [arXiv:2310.01460], where the theory is also extended to cover the other fundamental interactions of the standard model. We devote ample space for details of the eight-spinor QED to provide solid mathematical basis for the present work and the related work on the Yang-Mills gauge theory of unified gravity.


title: A Comparison of Mesh-Free Differentiable Programming and Data-Driven Strategies for Optimal Control under PDE Constraints

abstract: The field of Optimal Control under Partial Differential Equations (PDE) constraints is rapidly changing under the influence of Deep Learning and the accompanying automatic differentiation libraries. Novel techniques like Physics-Informed Neural Networks (PINNs) and Differentiable Programming (DP) are to be contrasted with established numerical schemes like Direct-Adjoint Looping (DAL). We present a comprehensive comparison of DAL, PINN, and DP using a general-purpose mesh-free differentiable PDE solver based on Radial Basis Functions. Under Laplace and Navier-Stokes equations, we found DP to be extremely effective as it produces the most accurate gradients; thriving even when DAL fails and PINNs struggle. Additionally, we provide a detailed benchmark highlighting the limited conditions under which any of those methods can be efficiently used. Our work provides a guide to Optimal Control practitioners and connects them further to the Deep Learning community.


title: Three- and four-wave resonances in the nonlinear quadratic Kelvin lattice

abstract: In this paper we investigate analytically and numerically the nonlinear Kelvin lattice, namely a chain of masses and nonlinear springs, as in the alpha-Fermi-Pasta-Ulam-Tsingou (FPUT) chain, where, in addition, each mass is connected to a nonlinear resonator, i.e., a second mass free to oscillate. Both nonlinearities are quadratic in the equations of motion. This setup represents the simplest prototype of nonlinear wave propagation on a nonlinear metamaterial. In the linear case, we diagonalize the system, and the two branches of the dispersion relation can be found. Using this result, we derive in the nonlinear case the equations of motion for the normal variables in Fourier space, obtaining a system governed by triad interactions among the two branches of the dispersion relation. We find that the transfer of energy between these two branches is ruled by three- and four-wave resonant interactions. We perform numerical simulations of the primitive equations of motion and highlight the role of resonances as an efficient mechanism for transferring energy. Moreover, as predicted by the theory, we provide direct evidence that four-wave resonances appear on a time scale that is longer than the time scale for three-wave resonances. We also assess the recurrence behaviour (usual in the FPUT system) for the nonlinear Kelvin lattice, and we show that, while recurrence is observed if all the energy is placed, at time t=0, in the lowest mode of the acoustical branch, a non-recurrent behaviour is observed if the initial energy is located in the optical branch.


title: Vortex Effects in Merging Black Holes and Saturons

abstract: Vorticity has recently been suggested to be a property of highly-spinning black holes. The connection between vorticity and limiting spin represents a universal feature shared by objects of maximal microstate entropy, so-called saturons. Using $Q$-ball-like saturons as a laboratory for black holes, we study the collision of two such objects and find that vorticity can have a large impact on the emitted radiation as well as on the charge and angular momentum of the final configuration. As black holes belong to the class of saturons, we expect that the formation of vortices can cause similar effects in black hole mergers, leading to macroscopic deviations in gravitational radiation. This could leave unique signatures detectable with upcoming gravitational-wave searches, which can thereby serve as a portal to macroscopic quantum effects in black holes.


title: A combinatorial construction of the moduli space of flowlines in discrete Morse theory

abstract: We construct the moduli space of index 2 flowlines of a discrete Morse function, giving a new proof that the Morse differential squares to zero in discrete Morse homology.


title: Indefinite order in the interface of quantum mechanics and gravity

abstract: Researchers have long been aiming to understand how the characteristics of Quantum Theory and General Relativity combine to account for regimes in their interface. One reason why this is a hard task is how differently the theories approach time and causality. For instance, causal structure in relativity is determined by the distribution of mass in spacetime while, in the quantum formalism, it is supposed to be fixed and given in advance. In this master's thesis, we discuss the notion of indefinite order, which first appears in an abstract generalization of Quantum Theory [...] where the demand for global causal structure is removed, in principle allowing cases for which the order of operations in protocols is not necessarily well defined. One epitomical example of indefinite order is the quantum switch process, which realizes a quantum superposition of orders of two operations on a target system. The quantum switch probabilities have been reproduced in experimental optical setups that are fully described in principle by quantum mechanics. Since these experiments are compatible with spacetime causal structure, this generated uncertainty about the conclusions that can be drawn from obtaining these results depending on the context. Here, we return to the initial motivations and also present how scenarios involving gravity in low energies could lead to indefinite order. This includes the formulation of a quantum switch in a quantum gravity scenario and of a quantum switch in a classical Schwarzschild metric. The switch then provides a common ground to discuss different kinds of setups. The latter proposal of a quantum switch in a classical metric is an original work that, aside from being an example of indefinite order, proposes the realization of the protocol in Earth's gravity as a test of quantum mechanics on curved spacetimes, a regime which has not yet been explored experimentally.


title: Sufficient Loading Conditions for Self-organization in the $n$-dimensional Version of BML Model with Stochastic Direction Choice

abstract: A dynamical system is considered, which comprises an $n$-dimensional lattice $N_1 \times N_2 \times \dots \times N_n$ with periodic boundary conditions. Particles traverse this lattice following a variant of the Biham--Middleton--Levine (BML) traffic model's particle movement rules. We have proved that the BML model, when treated as a dynamical system, constitutes a specialized class of a Buslaev net. This equivalence allows us to employ established Buslaev net analysis techniques to investigate the BML model. In Buslaev nets conception the self-organization property of the system corresponds to the existance of velocity single point spectrum equal to 1. One notable aspect of the model under consideration is that particles can change their type with a certain probability. For simplicity, we assume a constant probability $q$ that a particle changes type at each step. In the l case where $q=0$, the system corresponds to the classical version of the BML model. We define a state of the system where all particles continue to move indefinitely, both in the present and the future, as a state of free movement. A sufficient condition for the system to result in a state of free movement from any initial state (condition for self-organization) has been found. This condition is that the number of particles be not greater than half the greatest common divisor of the numbers $N_1$ $N_2,\dots,N_n.$


title: What you see is not what is there: Mechanisms, models, and methods for point pattern deviations

abstract: Many natural systems are observed as point patterns in time, space, or space and time. Examples include plant and cellular systems, animal colonies, earthquakes, and wildfires. In practice the locations of the points are not always observed correctly. However, in the point process literature, there has been relatively scant attention paid to the issue of errors in the location of points. In this paper, we discuss how the observed point pattern may deviate from the actual point pattern and review methods and models that exist to handle such deviations. The discussion is supplemented with several scientific illustrations.


title: Converging trend of global urban land expansion sheds new light on sustainable development

abstract: Urban land growth presents a major sustainability challenge, yet its growth patterns and dynamics remain unclear. We quantified urban land evolution by analyzing its statistical distribution in 14 regions and countries over 29 years. The results show a converging temporal trend in urban land expansion from sub-country to global scales, characterized by a coherent shift of urban area distributions from initial power law to exponential distributions, with the consequences of reduced system stability and resilience, and increased exposure of urban populations to extreme heat and air pollution. These changes are attributed to the increased influence from external economies of scale associated with globalization and are predicted to intensify in the future. The findings will advance urban science and direct current land urbanization practices toward sustainable development, especially in developing regions and medium-size cities.


title: Beyond-Accuracy: A Review on Diversity, Serendipity and Fairness in Recommender Systems Based on Graph Neural Networks

abstract: By providing personalized suggestions to users, recommender systems have become essential to numerous online platforms. Collaborative filtering, particularly graph-based approaches using Graph Neural Networks (GNNs), have demonstrated great results in terms of recommendation accuracy. However, accuracy may not always be the most important criterion for evaluating recommender systems' performance, since beyond-accuracy aspects such as recommendation diversity, serendipity, and fairness can strongly influence user engagement and satisfaction. This review paper focuses on addressing these dimensions in GNN-based recommender systems, going beyond the conventional accuracy-centric perspective. We begin by reviewing recent developments in approaches that improve not only the accuracy-diversity trade-off but also promote serendipity and fairness in GNN-based recommender systems. We discuss different stages of model development including data preprocessing, graph construction, embedding initialization, propagation layers, embedding fusion, score computation, and training methodologies. Furthermore, we present a look into the practical difficulties encountered in assuring diversity, serendipity, and fairness, while retaining high accuracy. Finally, we discuss potential future research directions for developing more robust GNN-based recommender systems that go beyond the unidimensional perspective of focusing solely on accuracy. This review aims to provide researchers and practitioners with an in-depth understanding of the multifaceted issues that arise when designing GNN-based recommender systems, setting our work apart by offering a comprehensive exploration of beyond-accuracy dimensions.