title: STREAM: Spatio-TempoRal Evaluation and Analysis Metric for Video Generative Models

abstract: Image generative models have made significant progress in generating realistic and diverse images, supported by comprehensive guidance from various evaluation metrics. However, current video generative models struggle to generate even short video clips, with limited tools that provide insights for improvements. Current video evaluation metrics are simple adaptations of image metrics by switching the embeddings with video embedding networks, which may underestimate the unique characteristics of video. Our analysis reveals that the widely used Frechet Video Distance (FVD) has a stronger emphasis on the spatial aspect than the temporal naturalness of video and is inherently constrained by the input size of the embedding networks used, limiting it to 16 frames. Additionally, it demonstrates considerable instability and diverges from human evaluations. To address the limitations, we propose STREAM, a new video evaluation metric uniquely designed to independently evaluate spatial and temporal aspects. This feature allows comprehensive analysis and evaluation of video generative models from various perspectives, unconstrained by video length. We provide analytical and experimental evidence demonstrating that STREAM provides an effective evaluation tool for both visual and temporal quality of videos, offering insights into area of improvement for video generative models. To the best of our knowledge, STREAM is the first evaluation metric that can separately assess the temporal and spatial aspects of videos. Our code is available at https://github.com/pro2nit/STREAM.


title: Deformation of superintegrability in the Miwa-deformed Gaussian matrix model

abstract: We consider an arbitrary deformation of the Gaussian matrix model parameterized by Miwa variables $z_a$. One can look at it as a mixture of the Gaussian and logarithmic (Selberg) potentials, which are both superintegrable. The mixture is not, still one can find an explicit expression for an arbitrary Schur average as a linear transform of a {\it finite degree} polynomial made from the values of skew Schur functions at the Gaussian locus $p_k=\delta_{k,2}$. This linear operation includes multiplication with an exponential $ e^{z_a^2/2}$ and a kind of Borel transform of the resulting product, which we call multiple and enhanced. The existence of such remarkable formulas appears intimately related to the theory of auxiliary $K$-polynomials, which appeared in {\it bilinear} superintegrable correlators at the Gaussian point (strict superintegrability). We also consider in the very detail the generating function of correlators $<(\Tr X)^k>$ in this model, and discuss its integrable determinant representation. At last, we describe deformation of all results to the Gaussian $\beta$-ensemble.


title: CoRaiS: Lightweight Real-Time Scheduler for Multi-Edge Cooperative Computing

abstract: Multi-edge cooperative computing that combines constrained resources of multiple edges into a powerful resource pool has the potential to deliver great benefits, such as a tremendous computing power, improved response time, more diversified services. However, the mass heterogeneous resources composition and lack of scheduling strategies make the modeling and cooperating of multi-edge computing system particularly complicated. This paper first proposes a system-level state evaluation model to shield the complex hardware configurations and redefine the different service capabilities at heterogeneous edges. Secondly, an integer linear programming model is designed to cater for optimally dispatching the distributed arriving requests. Finally, a learning-based lightweight real-time scheduler, CoRaiS, is proposed. CoRaiS embeds the real-time states of multi-edge system and requests information, and combines the embeddings with a policy network to schedule the requests, so that the response time of all requests can be minimized. Evaluation results verify that CoRaiS can make a high-quality scheduling decision in real time, and can be generalized to other multi-edge computing system, regardless of system scales. Characteristic validation also demonstrates that CoRaiS successfully learns to balance loads, perceive real-time state and recognize heterogeneity while scheduling.


title: COMPRER: A Multimodal Multi-Objective Pretraining Framework for Enhanced Medical Image Representation

abstract: Substantial advances in multi-modal Artificial Intelligence (AI) facilitate the combination of diverse medical modalities to achieve holistic health assessments. We present COMPRER , a novel multi-modal, multi-objective pretraining framework which enhances medical-image representation, diagnostic inferences, and prognosis of diseases. COMPRER employs a multi-objective training framework, where each objective introduces distinct knowledge to the model. This includes a multimodal loss that consolidates information across different imaging modalities; A temporal loss that imparts the ability to discern patterns over time; Medical-measure prediction adds appropriate medical insights; Lastly, reconstruction loss ensures the integrity of image structure within the latent space. Despite the concern that multiple objectives could weaken task performance, our findings show that this combination actually boosts outcomes on certain tasks. Here, we apply this framework to both fundus images and carotid ultrasound, and validate our downstream tasks capabilities by predicting both current and future cardiovascular conditions. COMPRER achieved higher Area Under the Curve (AUC) scores in evaluating medical conditions compared to existing models on held-out data. On the Out-of-distribution (OOD) UK-Biobank dataset COMPRER maintains favorable performance over well-established models with more parameters, even though these models were trained on $75\times$ more data than COMPRER. In addition, to better assess our model's performance in contrastive learning, we introduce a novel evaluation metric, providing deeper understanding of the effectiveness of the latent space pairing.


title: FoldToken: Learning Protein Language via Vector Quantization and Beyond

abstract: Is there a foreign language describing protein sequences and structures simultaneously? Protein structures, represented by continuous 3D points, have long posed a challenge due to the contrasting modeling paradigms of discrete sequences. We introduce \textbf{FoldTokenizer} to represent protein sequence-structure as discrete symbols. This innovative approach involves projecting residue types and structures into a discrete space, guided by a reconstruction loss for information preservation. We refer to the learned discrete symbols as \textbf{FoldToken}, and the sequence of FoldTokens serves as a new protein language, transforming the protein sequence-structure into a unified modality. We apply the created protein language on general backbone inpainting and antibody design tasks, building the first GPT-style model (\textbf{FoldGPT}) for sequence-structure co-generation with promising results. Key to our success is the substantial enhancement of the vector quantization module, Soft Conditional Vector Quantization (\textbf{SoftCVQ}).


title: Navigating the Peril of Generated Alternative Facts: A ChatGPT-4 Fabricated Omega Variant Case as a Cautionary Tale in Medical Misinformation

abstract: In an era where artificial intelligence (AI) intertwines with medical research, the delineation of truth becomes increasingly complex. This study ostensibly examines a purported novel SARS-CoV-2 variant, dubbed the Omega variant, showcasing 31 unique mutations in the S gene region. However, the real undercurrent of this narrative is a demonstration of the ease with which AI, specifically ChatGPT-4, can fabricate convincing yet entirely fictional scientific data. The so-called Omega variant was identified in a fully vaccinated, previously infected 35-year-old male presenting with severe COVID-19 symptoms. Through a detailed, albeit artificial, genomic analysis and contact tracing, this study mirrors the rigorous methodology of genuine case reports, thereby setting the stage for a compelling but entirely constructed narrative. The entire case study was generated by ChatGPT-4, a large language model by OpenAI. The fabricated Omega variant features an ensemble of mutations, including N501Y and E484K, known for enhancing ACE2 receptor affinity, alongside L452R and P681H, ostensibly indicative of immune evasion. This variant's contrived interaction dynamics - severe symptoms in a vaccinated individual versus mild ones in unvaccinated contacts - were designed to mimic real-world complexities, including suggestions of antibody-dependent enhancement (ADE). While the Omega variant is a product of AI-generated fiction, the implications of this exercise are real and profound. The ease with which AI can generate believable but false scientific information, as illustrated in this case, raises significant concerns about the potential for misinformation in medicine. This study, therefore, serves as a cautionary tale, emphasizing the necessity for critical evaluation of sources, especially in an age where AI tools like ChatGPT are becoming increasingly sophisticated and widespread in their use.


title: Open-Universe Indoor Scene Generation using LLM Program Synthesis and Uncurated Object Databases

abstract: We present a system for generating indoor scenes in response to text prompts. The prompts are not limited to a fixed vocabulary of scene descriptions, and the objects in generated scenes are not restricted to a fixed set of object categories -- we call this setting indoor scene generation. Unlike most prior work on indoor scene generation, our system does not require a large training dataset of existing 3D scenes. Instead, it leverages the world knowledge encoded in pre-trained large language models (LLMs) to synthesize programs in a domain-specific layout language that describe objects and spatial relations between them. Executing such a program produces a specification of a constraint satisfaction problem, which the system solves using a gradient-based optimization scheme to produce object positions and orientations. To produce object geometry, the system retrieves 3D meshes from a database. Unlike prior work which uses databases of category-annotated, mutually-aligned meshes, we develop a pipeline using vision-language models (VLMs) to retrieve meshes from massive databases of un-annotated, inconsistently-aligned meshes. Experimental evaluations show that our system outperforms generative models trained on 3D data for traditional, closed-universe scene generation tasks; it also outperforms a recent LLM-based layout generation method on open-universe scene generation.


title: Unmasking the Shadows of AI: Investigating Deceptive Capabilities in Large Language Models

abstract: This research critically navigates the intricate landscape of AI deception, concentrating on deceptive behaviours of Large Language Models (LLMs). My objective is to elucidate this issue, examine the discourse surrounding it, and subsequently delve into its categorization and ramifications. The essay initiates with an evaluation of the AI Safety Summit 2023 (ASS) and introduction of LLMs, emphasising multidimensional biases that underlie their deceptive behaviours.The literature review covers four types of deception categorised: Strategic deception, Imitation, Sycophancy, and Unfaithful Reasoning, along with the social implications and risks they entail. Lastly, I take an evaluative stance on various aspects related to navigating the persistent challenges of the deceptive AI. This encompasses considerations of international collaborative governance, the reconfigured engagement of individuals with AI, proposal of practical adjustments, and specific elements of digital education.


title: Rapid and Robust construction of an ML-ready peak feature table from X-ray diffraction data using Bayesian peak-top fitting

abstract: To advance the development of materials through data-driven scientific methods, appropriate methods for building machine learning (ML)-ready feature tables from measured and computed data must be established. In materials development, X-ray diffraction (XRD) is an effective technique for analysing crystal structures and other microstructural features that have information that can explain material properties. Therefore, the fully automated extraction of peak features from XRD data without the bias of an analyst is a significant challenge. This study aimed to establish an efficient and robust approach for constructing peak feature tables that follow ML standards (ML-ready) from XRD data. We challenge peak feature extraction in the situation where only the peak function profile is known a priori, without knowledge of the measurement material or crystal structure factor. We utilized Bayesian estimation to extract peak features from XRD data and subsequently performed Bayesian regression analysis with feature selection to predict the material property. The proposed method focused only on the tops of peaks within localized regions of interest (ROIs) and extracted peak features quickly and accurately. This process facilitated the rapid extracting of major peak features from the XRD data and the construction of an ML-ready feature table. We then applied Bayesian linear regression to the maximum energy product $(BH)_{max}$, using the extracted peak features as the explanatory variable. The outcomes yielded reasonable and robust regression results. Thus, the findings of this study indicated that \textit{004} peak height and area were important features for predicting $(BH)_{max}$.


title: A Quasi-Stationary Approach to Metastability in a System of Spiking Neurons with Synaptic Plasticity

abstract: After reviewing the behavioral studies of working memory and of the cellular substrate of the latter, we argue that metastable states constitute candidates for the type of transient information storage required by working memory. We then present a simple neural network model made of stochastic units whose synapses exhibit short-term facilitation. The Markov process dynamics of this model was specifically designed to be analytically tractable, simple to simulate numerically and to exhibit a quasi-stationary distribution (QSD). Since the state space is finite this QSD is also a Yaglom limit, which allows us to bridge the gap between quasi-stationarity and metastability by considering the relative orders of magnitude of the relaxation and absorption times. We present first analytical results: characterization of the absorbing region of the Markov process, irreducibility outside this absorbing region and consequently existence and uniqueness of a QSD. We then apply Perron-Frobenius spectral analysis to obtain any specific QSD, and design an approximate method for the first moments of this QSD when the exact method is intractable. Finally we use these methods to study the relaxation time toward the QSD and establish numerically the memorylessness of the time of extinction.


title: Extended defects as a source of phonon confinement in polycrystalline Si and Ge films

abstract: We present Raman spectroscopy of the polycrystalline Si and Ge films deposited by molecular beam deposition on a dielectric substrate. The Raman study has been made using lasers with different wavelengths. Structural properties of the poly-films have been studied by XRD and TEM. The Raman spectra are characterized by appearance of the additional wide peaks around 500 cm$^{-1}$ and 290 cm$^{-1}$ in the main vibrational bands of TO(c-Si) and TO(c-Ge) phonons, respectively. It is shown that these peaks correspond to scattering in grain boundary area. For the poly-Si films, both a downward shift and an asymmetrical broadening of the vibrational band of TO(c-Si) near 520 cm$^{-1}$ are observed, whereas there is only a symmetric broadening in the spectra of poly-Ge. The Raman line shape has been modeled within the framework of the phonon confinement theory taking into account the sizes of coherent scattering domains obtained using XRD. The model includes a symmetrical band broadening observed in polycrystalline films. It is shown that confinement of phonon propagation might be in the poly-Si films. The phonon dispersion and the density of phonon states have been simulated using density functional theory. It has been found that phonon confinement relates to grain boundaries rather than other extended defects such as twins (multiple twins, twin boundaries), the appearance of which does not lead to significant changes in phonon dispersion and density of phonon states.


title: Pre-Sorted Tsetlin Machine (The Genetic K-Medoid Method)

abstract: This paper proposes a machine learning pre-sort stage to traditional supervised learning using Tsetlin Machines. Initially, K data-points are identified from the dataset using an expedited genetic algorithm to solve the maximum dispersion problem. These are then used as the initial placement to run the K-Medoid clustering algorithm. Finally, an expedited genetic algorithm is used to align K independent Tsetlin Machines by maximising hamming distance. For MNIST level classification problems, results demonstrate up to 10% improvement in accuracy, approx. 383X reduction in training time and approx. 86X reduction in inference time.


title: ViT-MUL: A Baseline Study on Recent Machine Unlearning Methods Applied to Vision Transformers

abstract: Machine unlearning (MUL) is an arising field in machine learning that seeks to erase the learned information of specific training data points from a trained model. Despite the recent active research in MUL within computer vision, the majority of work has focused on ResNet-based models. Given that Vision Transformers (ViT) have become the predominant model architecture, a detailed study of MUL specifically tailored to ViT is essential. In this paper, we present comprehensive experiments on ViTs using recent MUL algorithms and datasets. We anticipate that our experiments, ablation studies, and findings could provide valuable insights and inspire further research in this field.


title: On the Theory of Quantum and Towards Practical Computation

abstract: Quantum computing exposes the brilliance of quantum mechanics through computer science and, as such, gives oneself a marvelous and exhilarating journey to go through. This article leads along that journey with a historical and current outlook on quantum computation that is geared toward computer experts but also to experts from other disciplines as well. It is an article that will bridge the vast gap between classical and quantum computation and open an entering wedge through which one will be able to both bring himself up to speed on quantum computation and, intrinsically, in a straightforward manner, become acquainted with it. We are indeed in luck to be living in an age where computing is being reinvented, and not only seeing history in the making firsthand but, in fact, having the opportunity to be the ones who are reinventing--and that is quite a thought.


title: Counterfactual Image Editing

abstract: Counterfactual image editing is an important task in generative AI, which asks how an image would look if certain features were different. The current literature on the topic focuses primarily on changing individual features while remaining silent about the causal relationships between these features, as present in the real world. In this paper, we formalize the counterfactual image editing task using formal language, modeling the causal relationships between latent generative factors and images through a special type of model called augmented structural causal models (ASCMs). Second, we show two fundamental impossibility results: (1) counterfactual editing is impossible from i.i.d. image samples and their corresponding labels alone; (2) even when the causal relationships between the latent generative factors and images are available, no guarantees regarding the output of the model can be provided. Third, we propose a relaxation for this challenging problem by approximating non-identifiable counterfactual distributions with a new family of counterfactual-consistent estimators. This family exhibits the desirable property of preserving features that the user cares about across both factual and counterfactual worlds. Finally, we develop an efficient algorithm to generate counterfactual images by leveraging neural causal models.


title: Thermal oscillations and resonance in electron-phonon interaction process

abstract: Thermal resonance, in which the temperature amplitude attains a maximum value (peak) in response to an external exciting frequency source, is a phenomenon pertinent to the presence of underdamped thermal oscillations and explicit finite-speed for the thermal wave propagation. The present work investigates the occurrence condition for thermal resonance phenomenon during the electron-phonon interaction process in metals based on the hyperbolic two-temperature model. First, a sufficient condition for underdamped electron and lattice temperature oscillations is discussed by deriving a critical frequency (a material characteristic). It is shown that the critical frequency of thermal waves near room temperature, during electron-phonon interactions, may be on the order of terahertz ($10-20$ THz for Cu and Au, i.e., lying within the terahertz gap). It is found that whenever the natural frequency of metal temperature exceeds this frequency threshold, the temperature oscillations are of underdamped type. However, this condition is not necessary, since there is a small frequency domain, below this threshold, in which the underdamped thermal wave solution is available but not effective. Otherwise, the critical damping and the overdamping conditions of the temperature waves are determined numerically for a sample of pure metals. The thermal resonance conditions in both electron and lattice temperatures are investigated. The occurrence of resonance in both electron and lattice temperature is conditional on violating two distinct critical values of frequencies. When the natural frequency of the system becomes larger than these two critical values, an applied frequency equal to such a natural frequency can drive both electron and lattice temperatures to resonate together with different amplitudes and behaviors. However, the electron temperature resonates earlier than the lattice temperature.


title: A space-time gauge theory for modeling ductile damage and its NOSB peridynamic implementation

abstract: Local translational and scaling symmetries in space-time is exploited for modelling ductile damage in metals and alloys over wide ranges of strain rate and temperature. The invariant energy density corresponding to the ductile deformation is constructed through the gauge invariant curvature tensor by imposing the Weyl like condition. The energetics of the plastic deformation is brought in through the gauge compensating field emerged due to local translation. Invariance of the energy density under the local action of translation and scaling is preserved through minimally replaced space-time gauge covariant operators. Minimal replacement introduces two non-trivial gauge compensating fields pertaining to local translation and scaling. These are used to describe ductile damage, including plastic flow and micro-crack evolution in the material. A space-time pseudo-Riemannian metric is used to lay out the kinematics in a finite-deformation setting. Recognizing the available insights in classical theories of viscoplasticity, we also establish a correspondence of the gauge compensating field due to spatial translation with Kr\"{o}ner's multiplicative decomposition of the deformation gradient. Thermodynamically consistent coupling between viscoplasticity and ductile damage is ensured through an appropriate degradation function. Non-ordinary state-based (NOSB) peridynamics (PD) discretization of the model is used for numerical implementation. The model's viability is tested in reproducing a few experimentally known facts, viz., strain rate locking in the stress-strain response, whose origin is traced to a nonlinear microscopic inertia term arising out of the space-time translation symmetry. Finally, we solved 2D and axisymmetric deformation problems for qualitatively validating the model's viability. NOSB peridynamics axisymmetric formulation in finite deformation setup is also presented.


title: About the second law of mechanical heat theory (\"Uber den zweiten Hauptsatz der mechanischen W\"armetheorie)

abstract: This is an English (annotated) translation of the Thesis report (in German) of Max Planck at the University of Munich (1879)


title: On the equilibrium states of isotropic bodies at different temperatures (\"Uber Gleichgewichtszust\"ande isotroper K\"orper in verschiedenen Temperaturen)

abstract: This is an English (annotated) translation of the Habilitation-Thesis report (in German) of Max Planck at the University of Munich (1880)


title: The principle of the conservation of energy (Das Princip der Erhaltung der Energie)

abstract: This is an English (annotated) translation of the German paper by Max Planck (1887) about "The principle of the conservation of energy"


title: The history of the discovery of the physical quantum of action (Zur Geschichte der Auffindung des physikalischen Wirkungsquantums)

abstract: This is an English (annotated) translation of the German paper by Max Planck (1943) about "The history of the discovery of the physical quantum of action"


title: Cutting a Wire with Non-Maximally Entangled States

abstract: Distributed quantum computing supports combining the computational power of multiple quantum devices to overcome the limitations of individual devices. Circuit cutting techniques enable the distribution of quantum computations via classical communication. These techniques involve partitioning a quantum circuit into smaller subcircuits, each containing fewer qubits. The original circuit's outcome can be replicated by executing these subcircuits on separate devices and combining their results. However, the number of circuit executions required to achieve a fixed result accuracy with circuit cutting grows exponentially with the number of cuts, posing significant costs. In contrast, quantum teleportation allows the distribution of quantum computations without an exponential increase in circuit executions. Nevertheless, each teleportation requires a pre-shared pair of maximally entangled qubits for transmitting a quantum state, and non-maximally entangled qubits cannot be used for this purpose. Addressing this, our work explores utilizing non-maximally entangled qubit pairs in wire cutting, a specific form of circuit cutting, to mitigate the associated costs. The cost of this cutting procedure reduces with the increasing degree of entanglement in the pre-shared qubit pairs. We derive the optimal sampling overhead in this context and present a wire cutting technique employing pure non-maximally entangled states that achieves this optimal sampling overhead. Hence, this offers a continuum between existing wire cutting and quantum teleportation.


title: A remark on large even integers of the form $p+P_3$

abstract: Let $N$ denotes a sufficiently large even integer, $p$ denotes a prime and $P_{r}$ denotes an integer with at most $r$ prime factors. In this paper, we study the solutions of the equation $N-p=P_3$ and consider two special cases where $p$ is small, and $p,P_3$ are within short intervals.


title: Phonon Linewidths in Twisted Bilayer Graphene near Magic Angle

abstract: We present a computational study of the phonon linewidths in twisted bilayer graphene arising from electron-phonon interactions and anharmonic effects. The electronic structure is calculated using distance-dependent transfer integrals based on the atomistic Slater-Koster tight-binding formalism. Furthermore, electron-electron interactions are treated at the Hartree level. The force constants for the phonon calculations are generated from classical force fields. These ingredients are used to calculate the phonon linewidths arising from electron-phonon interactions. Additionally, we account for the effects of phonon-phonon interactions on the linewidths by computing the mode-projected velocity autocorrelation function from classical molecular dynamics. Our findings show that both electron-phonon and anharmonic effects have a significant impact on the linewidth of the Raman active G mode near the magic angle. We predict a moir\'e potential induced splitting of this mode, which arises due to contributions from high symmetry stacking regions.


title: A Constrained Deep Reinforcement Learning Optimization for Reliable Network Slicing in a Blockchain-Secured Low-Latency Wireless Network

abstract: Network slicing (NS) is a promising technology that supports diverse requirements for next-generation low-latency wireless communication networks. However, the tampering attack is a rising issue of jeopardizing NS service-provisioning. To resist tampering attacks in NS networks, we propose a novel optimization framework for reliable NS resource allocation in a blockchain-secured low-latency wireless network, where trusted base stations (BSs) with high reputations are selected for blockchain management and NS service-provisioning. For such a blockchain-secured network, we consider that the latency is measured by the summation of blockchain management and NS service-provisioning, whilst the NS reliability is evaluated by the BS denial-of-service (DoS) probability. To satisfy the requirements of both the latency and reliability, we formulate a constrained computing resource allocation optimization problem to minimize the total processing latency subject to the BS DoS probability. To efficiently solve the optimization, we design a constrained deep reinforcement learning (DRL) algorithm, which satisfies both latency and DoS probability requirements by introducing an additional critic neural network. The proposed constrained DRL further solves the issue of high input dimension by incorporating feature engineering technology. Simulation results validate the effectiveness of our approach in achieving reliable and low-latency NS service-provisioning in the considered blockchain-secured wireless network.


title: Unidirectional pulses: relatively undistorted quasi-spherical waves, Fourier-Bessel integrals, and plane-waves decompositions

abstract: A theoretical description of a class of unidirectional axisymmetric localized pulses, is given. The equivalence of their representations in the form of relatively undistorted quasi-spherical waves, in the form of Fourier-Bessel integrals and in the form of a superposition of plane waves with wave vectors having positive projections on a given direction is established.


title: Convexity properties related to Gauss hypergeometric function

abstract: We investigate the convexity property on $(0,1)$ of the functions $\varphi_{a,b,c}$ and $1/\varphi_{a,b,c}$, where $$\varphi_{a,b,c}(x)= \frac{c-\log(1-x)}{\,_2F_1(a,b,a+b,x)},$$ whenever $a,b\geq 0$ and $a+b\leq 1$. We Show that $\varphi_{a,b,c}$ (respectively $1/\varphi_{a,b,c}$) is strictly convex on $(0,1)$ if and only if $c\leq -2\gamma-\psi(a)-\psi(b),$ (respectively $c\geq\alpha_0$) and $\varphi_{a,b,c}$ (respectively $1/\varphi_{a,b,c}$) is strictly concave on $(0,1)$ if and only if $c\geq c(a,b)$ (respectively $c\in[\delta_-,\delta_+]$), where $\psi$ is the Polygamma function. This generalizes some problems posed by Yang and Tian and complete the study of convexity properties of functions studied by the author in [bouali]. As applications of the convexity and concavity, we establish among other inequalities, that for all $x\in(0,1)$, $a,b\in[0,1]$, $a+b\leq 1$ and $c\geq c(a,b)$ $$c+\frac{\Gamma(a)\Gamma(b)}{\Gamma(a+b)}\leq \frac{c-\log(1-x)}{\,_2F_1(a,b,a+b,x)}+\frac{c-\log(x)}{\,_2F_1(a,b,a+b,1-x)}\leq\frac{(2c+2\log 2)}{\,_2{F}_1(a,b;a+b;1/2)},$$ and for all $x\in(0,1)$, $a,b\in[0,1]$, $a+b\leq 1$ and $c\in [\delta_-,\delta_+]$ $$\frac1c+\frac{\Gamma(a+b)}{\Gamma(a)\Gamma(b)}\leq \frac{\,_2F_1(a,b,a+b,x)}{c-\log(1-x)}+\frac{\,_2F_1(a,b,a+b,1-x)}{c-\log(x)}\leq\frac{\,_2{F}_1(a,b;a+b;1/2)}{(2c+2\log 2)}.$$


title: A Conditional Singular Value Decomposition

abstract: We propose a Conditional Singular Value Decomposition in the form of A_{mn} =H_{mk} B_{kl} M_{ln}^* for given general matrices A_{mn} and B_{kl} .


title: A Short Note on the Infinity Product Tan (z) Function

abstract: We derive the infinite product of the tangent function expressed in terms of trigonometric expressions such as Eulers Sinc function and Vietes formula, along with their generalizations. All the results presented in this work are novel.


title: New Generalizations of Morrie's Law and the Euler Product Formula

abstract: In this study, we derive the infinite product representation of the $\operatorname{sinc}(\mathrm{z})$ function by expressing it in a trigonometric form, evoking similarities to Morrie's Law and Euler's Product formula, along with their generalizations. The results presented in this investigation are entirely novel and are believed to introduce new insights into the topic.


title: On one map between singular expansions

abstract: The present article deals with properties of one map between two expansions of real numbers of the Salem type. Differential, integral, and other properties of the function were considered.


title: Shapley Values-Powered Framework for Fair Reward Split in Content Produced by GenAI

abstract: It is evident that, currently, generative models are surpassed in quality by human professionals. However, with the advancements in Artificial Intelligence, this gap will narrow, leading to scenarios where individuals who have dedicated years of their lives to mastering a skill become obsolete due to their high costs, which are inherently linked to the time they require to complete a task -- a task that AI could accomplish in minutes or seconds. To avoid future social upheavals, we must, even now, contemplate how to fairly assess the contributions of such individuals in training generative models and how to compensate them for the reduction or complete loss of their incomes. In this work, we propose a method to structure collaboration between model developers and data providers. To achieve this, we employ Shapley Values to quantify the contribution of artist(s) in an image generated by the Stable Diffusion-v1.5 model and to equitably allocate the reward among them.


title: A Natural Extension To Online Algorithms For Hybrid RL With Limited Coverage

abstract: Hybrid Reinforcement Learning (RL), leveraging both online and offline data, has garnered recent interest, yet research on its provable benefits remains sparse. Additionally, many existing hybrid RL algorithms (Song et al., 2023; Nakamoto et al., 2023; Amortila et al., 2024) impose coverage assumptions on the offline dataset, but we show that this is unnecessary. A well-designed online algorithm should "fill in the gaps" in the offline dataset, exploring states and actions that the behavior policy did not explore. Unlike previous approaches that focus on estimating the offline data distribution to guide online exploration (Li et al., 2023b), we show that a natural extension to standard optimistic online algorithms -- warm-starting them by including the offline dataset in the experience replay buffer -- achieves similar provable gains from hybrid data even when the offline dataset does not have single-policy concentrability. We accomplish this by partitioning the state-action space into two, bounding the regret on each partition through an offline and an online complexity measure, and showing that the regret of this hybrid RL algorithm can be characterized by the best partition -- despite the algorithm not knowing the partition itself. As an example, we propose DISC-GOLF, a modification of an existing optimistic online algorithm with general function approximation called GOLF used in Jin et al. (2021); Xie et al. (2022a), and show that it demonstrates provable gains over both online-only and offline-only reinforcement learning, with competitive bounds when specialized to the tabular, linear and block MDP cases. Numerical simulations further validate our theory that hybrid data facilitates more efficient exploration, supporting the potential of hybrid RL in various scenarios.


title: Generator-Guided Crowd Reaction Assessment

abstract: In the realm of social media, understanding and predicting post reach is a significant challenge. This paper presents a Crowd Reaction AssessMent (CReAM) task designed to estimate if a given social media post will receive more reaction than another, a particularly essential task for digital marketers and content writers. We introduce the Crowd Reaction Estimation Dataset (CRED), consisting of pairs of tweets from The White House with comparative measures of retweet count. The proposed Generator-Guided Estimation Approach (GGEA) leverages generative Large Language Models (LLMs), such as ChatGPT, FLAN-UL2, and Claude, to guide classification models for making better predictions. Our results reveal that a fine-tuned FLANG-RoBERTa model, utilizing a cross-encoder architecture with tweet content and responses generated by Claude, performs optimally. We further use a T5-based paraphraser to generate paraphrases of a given post and demonstrate GGEA's ability to predict which post will elicit the most reactions. We believe this novel application of LLMs provides a significant advancement in predicting social media post reach.


title: Concept-aware Data Construction Improves In-context Learning of Language Models

abstract: Many recent language models (LMs) are capable of in-context learning (ICL), manifested in the LMs' ability to perform a new task solely from natural-language instruction. Previous work curating in-context learners assumes that ICL emerges from a vast over-parametrization or the scale of multi-task training. However, recent theoretical work attributes the ICL ability to concept-dependent training data and creates functional in-context learners even in small-scale, synthetic settings. In this work, we practically explore this newly identified axis of ICL quality. We propose Concept-aware Training (CoAT), a framework for constructing training scenarios that make it beneficial for the LM to learn to utilize the analogical reasoning concepts from demonstrations. We find that by using CoAT, pre-trained transformers can learn to better utilise new latent concepts from demonstrations and that such ability makes ICL more robust to the functional deficiencies of the previous models. Finally, we show that concept-aware in-context learning is more effective for a majority of new tasks when compared to traditional instruction tuning, resulting in a performance comparable to the previous in-context learners using magnitudes of more training data.


title: Alignment Studio: Aligning Large Language Models to Particular Contextual Regulations

abstract: The alignment of large language models is usually done by model providers to add or control behaviors that are common or universally understood across use cases and contexts. In contrast, in this article, we present an approach and architecture that empowers application developers to tune a model to their particular values, social norms, laws and other regulations, and orchestrate between potentially conflicting requirements in context. We lay out three main components of such an Alignment Studio architecture: Framers, Instructors, and Auditors that work in concert to control the behavior of a language model. We illustrate this approach with a running example of aligning a company's internal-facing enterprise chatbot to its business conduct guidelines.


title: A Novel Nuanced Conversation Evaluation Framework for Large Language Models in Mental Health

abstract: Understanding the conversation abilities of Large Language Models (LLMs) can help lead to its more cautious and appropriate deployment. This is especially important for safety-critical domains like mental health, where someone's life may depend on the exact wording of a response to an urgent question. In this paper, we propose a novel framework for evaluating the nuanced conversation abilities of LLMs. Within it, we develop a series of quantitative metrics developed from literature on using psychotherapy conversation analysis literature. While we ensure that our framework and metrics are transferable by researchers to relevant adjacent domains, we apply them to the mental health field. We use our framework to evaluate several popular frontier LLMs, including some GPT and Llama models, through a verified mental health dataset. Our results show that GPT4 Turbo can perform significantly more similarly to verified therapists than other selected LLMs. We conduct additional analysis to examine how LLM conversation performance varies across specific mental health topics. Our results indicate that GPT4 Turbo performs well in achieving high correlation with verified therapists in particular topics such as Parenting and Relationships. We believe our contributions will help researchers develop better LLMs that, in turn, will more positively support people's lives.


title: Schema-Aware Multi-Task Learning for Complex Text-to-SQL

abstract: Conventional text-to-SQL parsers are not good at synthesizing complex SQL queries that involve multiple tables or columns, due to the challenges inherent in identifying the correct schema items and performing accurate alignment between question and schema items. To address the above issue, we present a schema-aware multi-task learning framework (named MTSQL) for complicated SQL queries. Specifically, we design a schema linking discriminator module to distinguish the valid question-schema linkings, which explicitly instructs the encoder by distinctive linking relations to enhance the alignment quality. On the decoder side, we define 6-type relationships to describe the connections between tables and columns (e.g., WHERE_TC), and introduce an operator-centric triple extractor to recognize those associated schema items with the predefined relationship. Also, we establish a rule set of grammar constraints via the predicted triples to filter the proper SQL operators and schema items during the SQL generation. On Spider, a cross-domain challenging text-to-SQL benchmark, experimental results indicate that MTSQL is more effective than baselines, especially in extremely hard scenarios. Moreover, further analyses verify that our approach leads to promising improvements for complicated SQL queries.


title: Understanding data analysis aspects of TMS-EEG in clinical study: a mini review and a case study with open dataset

abstract: Concurrency of transcranial magnetic stimulation with electroencephalography (TMS-EEG) technique is a powerful and challenging methodology for basic research and clinical applications. Aspects considered in experiments for effective TMS-EEG recordings and analysis, including artifact management, data analysis and interpretation and protocols. mini review offers an extensive insight of TMS-EEG methodology in experimental and computational procedures. Case study aims to leverage an openly available, high-quality EEG dataset to delve into the alterations in cortical activity. By applying Intermittent theta-burst stimulation (iTBS) and continuous theta-burst stimulation (cTBS) to the left dorsolateral prefrontal cortex (DLPFC) in healthy individuals, we observe changes in oscillatory patterns within the EEG data. The dataset includes meticulously extracted resting-state EEG recordings, TMS-evoked potential data, and MRI scans. To process these data, we utilized Brainstorm, an open-source Matlab application, which facilitated noise reduction through independent component analysis and signal-space projection techniques. It allowed us to identify, visualize, and analyze TMS-evoked potentials (TEPs) and TMS-induced oscillations (TIOs). In addition, the study presents detailed plots of resting-state EEG power, local mean field power (LMFP), TMS-related spectral perturbation (TSRP), and inter-trial phase clustering (ITPC). Paired t-tests and cluster-based permutation tests have been performed for statistical analysis. The wealth and quality of this dataset make it ideal for examining the neuromodulatory impact of TBS on the prefrontal cortex. Brainstorm's extensive feature set greatly supports the exploration of such neurological data. Future research directions could concentrate on conducting source localization analyses and comparative group studies.


title: Institutional-Level Monitoring of Immune Checkpoint Inhibitor IrAEs Using a Novel Natural Language Processing Algorithmic Pipeline

abstract: Background: Immune checkpoint inhibitors (ICIs) have revolutionized cancer treatment but can result in severe immune-related adverse events (IrAEs). Monitoring IrAEs on a large scale is essential for personalized risk profiling and assisting in treatment decisions. Methods: In this study, we conducted an analysis of clinical notes from patients who received ICIs at the Tel Aviv Sourasky Medical Center. By employing a Natural Language Processing algorithmic pipeline, we systematically identified seven common or severe IrAEs. We examined the utilization of corticosteroids, treatment discontinuation rates following IrAEs, and constructed survival curves to visualize the occurrence of adverse events during treatment. Results: Our analysis encompassed 108,280 clinical notes associated with 1,635 patients who had undergone ICI therapy. The detected incidence of IrAEs was consistent with previous reports, exhibiting substantial variation across different ICIs. Treatment with corticosteroids varied depending on the specific IrAE, ranging from 17.3% for thyroiditis to 57.4% for myocarditis. Our algorithm demonstrated high accuracy in identifying IrAEs, as indicated by an area under the curve (AUC) of 0.89 for each suspected note and F1 scores of 0.87 or higher for five out of the seven IrAEs examined at the patient level. Conclusions: This study presents a novel, large-scale monitoring approach utilizing deep neural networks for IrAEs. Our method provides accurate results, enhancing understanding of detrimental consequences experienced by ICI-treated patients. Moreover, it holds potential for monitoring other medications, enabling comprehensive post-marketing surveillance to identify susceptible populations and establish personalized drug safety profiles.


title: Exploratory Data Analysis on Code-mixed Misogynistic Comments

abstract: The problems of online hate speech and cyberbullying have significantly worsened since the increase in popularity of social media platforms such as YouTube and Twitter (X). Natural Language Processing (NLP) techniques have proven to provide a great advantage in automatic filtering such toxic content. Women are disproportionately more likely to be victims of online abuse. However, there appears to be a lack of studies that tackle misogyny detection in under-resourced languages. In this short paper, we present a novel dataset of YouTube comments in mix-code Hinglish collected from YouTube videos which have been weak labelled as `Misogynistic' and `Non-misogynistic'. Pre-processing and Exploratory Data Analysis (EDA) techniques have been applied on the dataset to gain insights on its characteristics. The process has provided a better understanding of the dataset through sentiment scores, word clouds, etc.


title: Linear-in-temperature resistivity and Planckian dissipation arise in a stochastic quantization model of Cooper pairs

abstract: We suppose that a Cooper pair (CP) will experience a damping force exerted by the condensed matter. A Langevin equation of a CP in two dimensional condensed matter is established. Following a method similar to Nelson's stochastic mechanics, generalized Schr\"{o}dinger equation of a CP in condensed matter is derived. If the CPs move with a constant velocity, then the corresponding direct current (DC) electrical conductivity can be calculated. Therefore, a Drude like formula of resistivity of CPs is derived. We suppose that the damping coefficient of CPs in two dimensional cuprate superconductors is a linear function of temperature. Then the resistivity and scattering rate of CPs turn out to be also linear-in-temperature. The origin of linear-in-temperature resistivity and Planckian dissipation in cuprate superconductors may be the linear temperature dependence of the damping coefficient of CPs.


title: Two-dimensional generalized gamma function and its applications

abstract: In this article, we present a new two-dimensional generalization of the gamma function based on the product of the one-dimensional generalized beta function and the one-dimensional generalized gamma function. As will become clear later, this generalization is also a generalization the famous formula that gives the connection between the classical gamma and beta functions. Next we present properties of this generalization, some series for the generalized beta function. As a practical application of the two-dimensional generalized gamma function, we will show how it can be used to represent a fairly wide class of double integrals in the form of functional series.


title: A Knowledge-Injected Curriculum Pretraining Framework for Question Answering

abstract: Knowledge-based question answering (KBQA) is a key task in NLP research, and also an approach to access the web data and knowledge, which requires exploiting knowledge graphs (KGs) for reasoning. In the literature, one promising solution for KBQA is to incorporate the pretrained language model (LM) with KGs by generating KG-centered pretraining corpus, which has shown its superiority. However, these methods often depend on specific techniques and resources to work, which may not always be available and restrict its application. Moreover, existing methods focus more on improving language understanding with KGs, while neglect the more important human-like complex reasoning. To this end, in this paper, we propose a general Knowledge-Injected Curriculum Pretraining framework (KICP) to achieve comprehensive KG learning and exploitation for KBQA tasks, which is composed of knowledge injection (KI), knowledge adaptation (KA) and curriculum reasoning (CR). Specifically, the KI module first injects knowledge into the LM by generating KG-centered pretraining corpus, and generalizes the process into three key steps that could work with different implementations for flexible application. Next, the KA module learns knowledge from the generated corpus with LM equipped with an adapter as well as keeps its original natural language understanding ability to reduce the negative impacts of the difference between the generated and natural corpus. Last, to enable the LM with complex reasoning, the CR module follows human reasoning patterns to construct three corpora with increasing difficulties of reasoning, and further trains the LM from easy to hard in a curriculum manner. We provide an implementation of the general framework, and evaluate the proposed KICP on four real-word datasets. The results demonstrate that our framework can achieve higher performances.


title: A Hybrid Intelligence Method for Argument Mining

abstract: Large-scale survey tools enable the collection of citizen feedback in opinion corpora. Extracting the key arguments from a large and noisy set of opinions helps in understanding the opinions quickly and accurately. Fully automated methods can extract arguments but (1) require large labeled datasets that induce large annotation costs and (2) work well for known viewpoints, but not for novel points of view. We propose HyEnA, a hybrid (human + AI) method for extracting arguments from opinionated texts, combining the speed of automated processing with the understanding and reasoning capabilities of humans. We evaluate HyEnA on three citizen feedback corpora. We find that, on the one hand, HyEnA achieves higher coverage and precision than a state-of-the-art automated method when compared to a common set of diverse opinions, justifying the need for human insight. On the other hand, HyEnA requires less human effort and does not compromise quality compared to (fully manual) expert analysis, demonstrating the benefit of combining human and artificial intelligence.


title: Linguistic Structure Induction from Language Models

abstract: Linear sequences of words are implicitly represented in our brains by hierarchical structures that organize the composition of words in sentences. Linguists formalize different frameworks to model this hierarchy; two of the most common syntactic frameworks are Constituency and Dependency. Constituency represents sentences as nested groups of phrases, while dependency represents a sentence by assigning relations between its words. Recently, the pursuit of intelligent machines has produced Language Models (LMs) capable of solving many language tasks with a human-level performance. Many studies now question whether LMs implicitly represent syntactic hierarchies. This thesis focuses on producing constituency and dependency structures from LMs in an unsupervised setting. I review the critical methods in this field and highlight a line of work that utilizes a numerical representation for binary constituency trees (Syntactic Distance). I present a detailed study on StructFormer (SF) (Shen et al., 2021), which retrofits a transformer encoder architecture with a parser network to produce constituency and dependency structures. I present six experiments to analyze and address this field's challenges; experiments include investigating the effect of repositioning the parser network within the SF architecture, evaluating subword-based induced trees, and benchmarking the models developed in the thesis experiments on linguistic tasks. Models benchmarking is performed by participating in the BabyLM challenge, published at CoNLL 2023 (Momen et al., 2023). The results of this thesis encourage further development in the direction of retrofitting transformer-based models to induce syntactic structures, supported by the acceptable performance of SF in different experimental settings and the observed limitations that require innovative solutions to advance the state of syntactic structure induction.


title: Textual analysis of End User License Agreement for red-flagging potentially malicious software

abstract: New software and updates are downloaded by end users every day. Each dowloaded software has associated with it an End Users License Agreements (EULA), but this is rarely read. An EULA includes information to avoid legal repercussions. However,this proposes a host of potential problems such as spyware or producing an unwanted affect in the target system. End users do not read these EULA's because of length of the document and users find it extremely difficult to understand. Text summarization is one of the relevant solution to these kind of problems. This require a solution which can summarize the EULA and classify the EULA as "Benign" or "Malicious". We propose a solution in which we have summarize the EULA and classify the EULA as "Benign" or "Malicious". We extract EULA text of different sofware's then we classify the text using eight different supervised classifiers. we use ensemble learning to classify the EULA as benign or malicious using five different text summarization methods. An accuracy of $95.8$\% shows the effectiveness of the presented approach.


title: Introductory notes on real-enriched categories

abstract: Real-enriched categories are categories with real numbers as enrichment. Precisely, a real-enriched category is a category enriched over the commutative and unital quantale composed of the unit interval and a continuous t-norm. These notes present a brief introduction to real-enriched categories, focusing on the presheaf monad and its submonads in the category of such categories.


title: Enhancing Depression-Diagnosis-Oriented Chat with Psychological State Tracking

abstract: Depression-diagnosis-oriented chat aims to guide patients in self-expression to collect key symptoms for depression detection. Recent work focuses on combining task-oriented dialogue and chitchat to simulate the interview-based depression diagnosis. Whereas, these methods can not well capture the changing information, feelings, or symptoms of the patient during dialogues. Moreover, no explicit framework has been explored to guide the dialogue, which results in some useless communications that affect the experience. In this paper, we propose to integrate Psychological State Tracking (POST) within the large language model (LLM) to explicitly guide depression-diagnosis-oriented chat. Specifically, the state is adapted from a psychological theoretical model, which consists of four components, namely Stage, Information, Summary and Next. We fine-tune an LLM model to generate the dynamic psychological state, which is further used to assist response generation at each turn to simulate the psychiatrist. Experimental results on the existing benchmark show that our proposed method boosts the performance of all subtasks in depression-diagnosis-oriented chat.


title: Comprehensive Implementation of TextCNN for Enhanced Collaboration between Natural Language Processing and System Recommendation

abstract: Natural Language Processing (NLP) is an important branch of artificial intelligence that studies how to enable computers to understand, process, and generate human language. Text classification is a fundamental task in NLP, which aims to classify text into different predefined categories. Text classification is the most basic and classic task in natural language processing, and most of the tasks in natural language processing can be regarded as classification tasks. In recent years, deep learning has achieved great success in many research fields, and today, it has also become a standard technology in the field of NLP, which is widely integrated into text classification tasks. Unlike numbers and images, text processing emphasizes fine-grained processing ability. Traditional text classification methods generally require preprocessing the input model's text data. Additionally, they also need to obtain good sample features through manual annotation and then use classical machine learning algorithms for classification. Therefore, this paper analyzes the application status of deep learning in the three core tasks of NLP (including text representation, word order modeling, and knowledge representation). This content explores the improvement and synergy achieved through natural language processing in the context of text classification, while also taking into account the challenges posed by adversarial techniques in text generation, text classification, and semantic parsing. An empirical study on text classification tasks demonstrates the effectiveness of interactive integration training, particularly in conjunction with TextCNN, highlighting the significance of these advancements in text classification augmentation and enhancement.


title: Mevaker: Conclusion Extraction and Allocation Resources for the Hebrew Language

abstract: In this paper, we introduce summarization MevakerSumm and conclusion extraction MevakerConc datasets for the Hebrew language based on the State Comptroller and Ombudsman of Israel reports, along with two auxiliary datasets. We accompany these datasets with models for conclusion extraction (HeConE, HeConEspc) and conclusion allocation (HeCross). All of the code, datasets, and model checkpoints used in this work are publicly available.


title: Fine-tuning vs Prompting, Can Language Models Understand Human Values?

abstract: Accurately handling the underlying support values in sentences is crucial for understanding the speaker's tendencies, yet it poses a challenging task in natural language understanding (NLU). In this article, we explore the potential of fine-tuning and prompt tuning in this downstream task, using the Human Value Detection 2023. Additionally, we attempt to validate whether models can effectively solve the problem based on the knowledge acquired during the pre-training stage. Simultaneously, our interest lies in the capabilities of large language models (LLMs) aligned with RLHF in this task, and some preliminary attempts are presented.


title: A Semantic Mention Graph Augmented Model for Document-Level Event Argument Extraction

abstract: Document-level Event Argument Extraction (DEAE) aims to identify arguments and their specific roles from an unstructured document. The advanced approaches on DEAE utilize prompt-based methods to guide pre-trained language models (PLMs) in extracting arguments from input documents. They mainly concentrate on establishing relations between triggers and entity mentions within documents, leaving two unresolved problems: a) independent modeling of entity mentions; b) document-prompt isolation. To this end, we propose a semantic mention Graph Augmented Model (GAM) to address these two problems in this paper. Firstly, GAM constructs a semantic mention graph that captures relations within and between documents and prompts, encompassing co-existence, co-reference and co-type relations. Furthermore, we introduce an ensembled graph transformer module to address mentions and their three semantic relations effectively. Later, the graph-augmented encoder-decoder module incorporates the relation-specific graph into the input embedding of PLMs and optimizes the encoder section with topology information, enhancing the relations comprehensively. Extensive experiments on the RAMS and WikiEvents datasets demonstrate the effectiveness of our approach, surpassing baseline methods and achieving a new state-of-the-art performance.


title: Enhancing Readmission Prediction with Deep Learning: Extracting Biomedical Concepts from Clinical Texts

abstract: Hospital readmission, defined as patients being re-hospitalized shortly after discharge, is a critical concern as it impacts patient outcomes and healthcare costs. Identifying patients at risk of readmission allows for timely interventions, reducing re-hospitalization rates and overall treatment costs. This study focuses on predicting patient readmission within less than 30 days using text mining techniques applied to discharge report texts from electronic health records (EHR). Various machine learning and deep learning methods were employed to develop a classification model for this purpose. A novel aspect of this research involves leveraging the Bio-Discharge Summary Bert (BDSS) model along with principal component analysis (PCA) feature extraction to preprocess data for deep learning model input. Our analysis of the MIMIC-III dataset indicates that our approach, which combines the BDSS model with a multilayer perceptron (MLP), outperforms state-of-the-art methods. This model achieved a recall of 94% and an area under the curve (AUC) of 75%, showcasing its effectiveness in predicting patient readmissions. This study contributes to the advancement of predictive modeling in healthcare by integrating text mining techniques with deep learning algorithms to improve patient outcomes and optimize resource allocation.


title: Texture Recognition Using a Biologically Plausible Spiking Phase-Locked Loop Model for Spike Train Frequency Decomposition

abstract: In this paper, we present a novel spiking neural network model designed to perform frequency decomposition of spike trains. Our model emulates neural microcircuits theorized in the somatosensory cortex, rendering it a biologically plausible candidate for decoding the spike trains observed in tactile peripheral nerves. We demonstrate the capacity of simple neurons and synapses to replicate the phase-locked loop (PLL) and explore the emergent properties when considering multiple spiking phase-locked loops (sPLLs) with diverse oscillations. We illustrate how these sPLLs can decode textures using the spectral features elicited in peripheral nerves. Leveraging our model's frequency decomposition abilities, we improve state-of-the-art performances on a Multifrequency Spike Train (MST) dataset. This work offers valuable insights into neural processing and presents a practical framework for enhancing artificial neural network capabilities in complex pattern recognition tasks.


title: ClaimVer: Explainable Claim-Level Verification and Evidence Attribution of Text Through Knowledge Graphs

abstract: In the midst of widespread misinformation and disinformation through social media and the proliferation of AI-generated texts, it has become increasingly difficult for people to validate and trust information they encounter. Many fact-checking approaches and tools have been developed, but they often lack appropriate explainability or granularity to be useful in various contexts. A text validation method that is easy to use, accessible, and can perform fine-grained evidence attribution has become crucial. More importantly, building user trust in such a method requires presenting the rationale behind each prediction, as research shows this significantly influences people's belief in automated systems. Localizing and bringing users' attention to the specific problematic content is also paramount, instead of providing simple blanket labels. In this paper, we present ClaimVer, a human-centric framework tailored to meet users' informational and verification needs by generating rich annotations and thereby reducing cognitive load. Designed to deliver comprehensive evaluations of texts, it highlights each claim, verifies it against a trusted knowledge graph (KG), presents the evidence, and provides succinct, clear explanations for each claim prediction. Finally, our framework introduces an attribution score, enhancing applicability across a wide range of downstream tasks.


title: RAD-PHI2: Instruction Tuning PHI-2 for Radiology

abstract: Small Language Models (SLMs) have shown remarkable performance in general domain language understanding, reasoning and coding tasks, but their capabilities in the medical domain, particularly concerning radiology text, is less explored. In this study, we investigate the application of SLMs for general radiology knowledge specifically question answering related to understanding of symptoms, radiological appearances of findings, differential diagnosis, assessing prognosis, and suggesting treatments w.r.t diseases pertaining to different organ systems. Additionally, we explore the utility of SLMs in handling text-related tasks with respect to radiology reports within AI-driven radiology workflows. We fine-tune Phi-2, a SLM with 2.7 billion parameters using high-quality educational content from Radiopaedia, a collaborative online radiology resource. The resulting language model, RadPhi-2-Base, exhibits the ability to address general radiology queries across various systems (e.g., chest, cardiac). Furthermore, we investigate Phi-2 for instruction tuning, enabling it to perform specific tasks. By fine-tuning Phi-2 on both general domain tasks and radiology-specific tasks related to chest X-ray reports, we create Rad-Phi2. Our empirical results reveal that Rad-Phi2 Base and Rad-Phi2 perform comparably or even outperform larger models such as Mistral-7B-Instruct-v0.2 and GPT-4 providing concise and precise answers. In summary, our work demonstrates the feasibility and effectiveness of utilizing SLMs in radiology workflows both for knowledge related queries as well as for performing specific tasks related to radiology reports thereby opening up new avenues for enhancing the quality and efficiency of radiology practice.


title: Inference for non-probability samples using the calibration approach for quantiles

abstract: Non-probability survey samples are examples of data sources that have become increasingly popular in recent years, also in official statistics. However, statistical inference based on non-probability samples is much more difficult because they are biased and are not representative of the target population (Wu, 2022). In this paper we consider a method of joint calibration for totals (Deville & S\"arndal, 1992) and quantiles (Harms & Duchesne, 2006) and use the proposed approach to extend existing inference methods for non-probability samples, such as inverse probability weighting, mass imputation and doubly robust estimators. By including quantile information in the estimation process non-linear relationships between the target and auxiliary variables can be approximated the way it is done in step-wise (constant) regression. Our simulation study has demonstrated that the estimators in question are more robust against model mis-specification and, as a result, help to reduce bias and improve estimation efficiency. Variance estimation for our proposed approach is also discussed. We show that existing inference methods can be used and that the resulting confidence intervals are at nominal levels. Finally, we applied the proposed methods to estimate the share of vacancies aimed at Ukrainian workers in Poland using an integrated set of administrative and survey data about job vacancies. The proposed approaches have been implemented in two R packages (nonprobsvy and jointCalib), which were used to conduct the simulation and empirical study


title: Investigating the performance of Retrieval-Augmented Generation and fine-tuning for the development of AI-driven knowledge-based systems

abstract: The development of generative large language models (G-LLM) opened up new opportunities for the development of new types of knowledge-based systems similar to ChatGPT, Bing, or Gemini. Fine-tuning (FN) and Retrieval-Augmented Generation (RAG) are the techniques that can be used to implement domain adaptation for the development of G-LLM-based knowledge systems. In our study, using ROUGE, BLEU, METEOR scores, and cosine similarity, we compare and examine the performance of RAG and FN for the GPT-J-6B, OPT-6.7B, LlaMA, LlaMA-2 language models. Based on measurements shown on different datasets, we demonstrate that RAG-based constructions are more efficient than models produced with FN. We point out that connecting RAG and FN is not trivial, because connecting FN models with RAG can cause a decrease in performance. Furthermore, we outline a simple RAG-based architecture which, on average, outperforms the FN models by 16% in terms of the ROGUE score, 15% in the case of the BLEU score, and 53% based on the cosine similarity. This shows the significant advantage of RAG over FN in terms of hallucination, which is not offset by the fact that the average 8% better METEOR score of FN models indicates greater creativity compared to RAG.


title: Simulating Weighted Automata over Sequences and Trees with Transformers

abstract: Transformers are ubiquitous models in the natural language processing (NLP) community and have shown impressive empirical successes in the past few years. However, little is understood about how they reason and the limits of their computational capabilities. These models do not process data sequentially, and yet outperform sequential neural models such as RNNs. Recent work has shown that these models can compactly simulate the sequential reasoning abilities of deterministic finite automata (DFAs). This leads to the following question: can transformers simulate the reasoning of more complex finite state machines? In this work, we show that transformers can simulate weighted finite automata (WFAs), a class of models which subsumes DFAs, as well as weighted tree automata (WTA), a generalization of weighted automata to tree structured inputs. We prove these claims formally and provide upper bounds on the sizes of the transformer models needed as a function of the number of states the target automata. Empirically, we perform synthetic experiments showing that transformers are able to learn these compact solutions via standard gradient-based training.


title: Proof and generalization of conjectures of Ramanujan Machine

abstract: The Ramanujan Machine project predicts new continued fraction representations of numbers expressed by important mathematical constants. Generally, the value of a continued fraction is found by reducing it to a second order linear difference equation. In this paper, we prove 38 conjectures by solving the equation in two ways, use of a differential equation or application of Petkov\v{s}ek's algorithm. Especially, in the former way, we can get strong generalization of 31 conjectures.


title: The existence and asymptotic stability of Plasma-Sheaths to the full Euler-Poisson system

abstract: The main concern of this paper is to study large-time behavior of the sheath to the full Euler-Poisson system. As is well known, the monotone stationary solution under the Bohm criterion can be referred to as the sheath which is formed by interactions of plasma with wall. So far, the existence and asymptotic stability of stationary solutions in one-dimensional half space to the full Euler-Poisson system have been proved in \cite{DYZ2021}. In the present paper, we extend the results in \cite{DYZ2021} to $N$-dimensional ($N$=1,2,3) half space. By assuming that the velocity of the positive ion satisfies the Bohm criterion at the far field, we establish the global unique existence and the large time asymptotic stability of the sheath in some weighted Sobolev spaces by weighted energy method. Moreover, the time-decay rates are also obtained. A key different point from \cite{DYZ2021} is to derive some boundary estimates on the derivative of the potential in the $x_1$-direction.


title: Selective nonlinearities removal from digital signals

abstract: Many instruments performing optical and non-optical imaging and sensing, such as Optical Coherence Tomography (OCT), Magnetic Resonance Imaging or Fourier-transform spectrometry, produce digital signals containing modulations, sine-like components, which only after Fourier transformation give information about the structure or characteristics of the investigated object. Due to the fundamental physics-related limitations of such methods, the distribution of these signal components is often nonlinear and, when not properly compensated, leads to the resolution, precision or quality drop in the final image. Here, we propose an innovative approach that has the potential to allow cleaning of the signal from the nonlinearities but most of all, it now allows to switch the given order off, leaving all others intact. The latter provides a tool for more in-depth analysis of the nonlinearity-inducing properties of the investigated object, which can lead to applications in early disease detection or more sensitive sensing of chemical compounds. We consider OCT signals and nonlinearities up to the third order. In our approach, we propose two neural networks: one to remove solely the second-order nonlinearity and the other for removing solely the third-order nonlinearity. The input of the networks is a novel two-dimensional data structure with all the information needed for the network to infer a nonlinearity-free signal. We describe the developed networks and present the results for second-order and third-order nonlinearity removal in OCT data representing the images of various objects: a mirror, glass, and fruits.


title: PET-SQL: A Prompt-Enhanced Two-Round Refinement of Text-to-SQL with Cross-consistency

abstract: Recent advancements in Text-to-SQL (Text2SQL) emphasize stimulating the large language models (LLM) on in-context learning, achieving significant results. Nevertheless, they face challenges when dealing with verbose database information and complex user intentions. This paper presents a two-stage framework to enhance the performance of current LLM-based natural language to SQL systems. We first introduce a novel prompt representation, called reference-enhanced representation, which includes schema information and randomly sampled cell values from tables to instruct LLMs in generating SQL queries. Then, in the first stage, question-SQL pairs are retrieved as few-shot demonstrations, prompting the LLM to generate a preliminary SQL (PreSQL). After that, the mentioned entities in PreSQL are parsed to conduct schema linking, which can significantly compact the useful information. In the second stage, with the linked schema, we simplify the prompt's schema information and instruct the LLM to produce the final SQL. Finally, as the post-refinement module, we propose using cross-consistency across different LLMs rather than self-consistency within a particular LLM. Our methods achieve new SOTA results on the Spider benchmark, with an execution accuracy of 87.6%.


title: OverleafCopilot: Empowering Academic Writing in Overleaf with Large Language Models

abstract: The rapid development of Large Language Models (LLMs) has facilitated a variety of applications from different domains. In this technical report, we explore the integration of LLMs and the popular academic writing tool, Overleaf, to enhance the efficiency and quality of academic writing. To achieve the above goal, there are three challenges: i) including seamless interaction between Overleaf and LLMs, ii) establishing reliable communication with the LLM provider, and iii) ensuring user privacy. To address these challenges, we present OverleafCopilot, the first-ever tool (i.e., a browser extension) that seamlessly integrates LLMs and Overleaf, enabling researchers to leverage the power of LLMs while writing papers. Specifically, we first propose an effective framework to bridge LLMs and Overleaf. Then, we developed PromptGenius, a website for researchers to easily find and share high-quality up-to-date prompts. Thirdly, we propose an agent command system to help researchers quickly build their customizable agents. OverleafCopilot (https://chromewebstore.google.com/detail/overleaf-copilot/eoadabdpninlhkkbhngoddfjianhlghb ) has been on the Chrome Extension Store, which now serves thousands of researchers. Additionally, the code of PromptGenius is released at https://github.com/wenhaomin/ChatGPT-PromptGenius. We believe our work has the potential to revolutionize academic writing practices, empowering researchers to produce higher-quality papers in less time.


title: Do Large Language Models Solve ARC Visual Analogies Like People Do?

abstract: The Abstraction Reasoning Corpus (ARC) is a visual analogical reasoning test designed for humans and machines (Chollet, 2019). We compared human and large language model (LLM) performance on a new child-friendly set of ARC items. Results show that both children and adults outperform most LLMs on these tasks. Error analysis revealed a similar "fallback" solution strategy in LLMs and young children, where part of the analogy is simply copied. In addition, we found two other error types, one based on seemingly grasping key concepts (e.g., Inside-Outside) and the other based on simple combinations of analogy input matrices. On the whole, "concept" errors were more common in humans, and "matrix" errors were more common in LLMs. This study sheds new light on LLM reasoning ability and the extent to which we can use error analyses and comparisons with human development to understand how LLMs solve visual analogies.


title: A Sophisticated Framework for the Accurate Detection of Phishing Websites

abstract: Phishing is an increasingly sophisticated form of cyberattack that is inflicting huge financial damage to corporations throughout the globe while also jeopardizing individuals' privacy. Attackers are constantly devising new methods of launching such assaults and detecting them has become a daunting task. Many different techniques have been suggested, each with its own pros and cons. While machine learning-based techniques have been most successful in identifying such attacks, they continue to fall short in terms of performance and generalizability. This paper proposes a comprehensive methodology for detecting phishing websites. The goal is to design a system that is capable of accurately distinguishing phishing websites from legitimate ones and provides generalized performance over a broad variety of datasets. A combination of feature selection, greedy algorithm, cross-validation, and deep learning methods have been utilized to construct a sophisticated stacking ensemble classifier. Extensive experimentation on four different phishing datasets was conducted to evaluate the performance of the proposed technique. The proposed algorithm outperformed the other existing phishing detection models obtaining accuracy of 97.49%, 98.23%, 97.48%, and 98.20% on dataset-1 (UCI Phishing Websites Dataset), dataset-2 (Phishing Dataset for Machine Learning: Feature Evaluation), dataset-3 (Phishing Websites Dataset), and dataset-4 (Web page phishing detection), respectively. The high accuracy values obtained across all datasets imply the models' generalizability and effectiveness in the accurate identification of phishing websites.


title: Negative pressure in the quantum vacuum

abstract: It is well known that a constant energy density of the vacuum produces a negative pressure. We show that, in the presence of special boundaries for the photon field, the virtual photons in the quantum vacuum may induce a negative pressure of this type. In this context, we find in particular that an anomalous quantum vacuum radiation is responsible for the appearance of this negative pressure in a system, which generates the tangential Casimir force [Z. Zhang, New J. Phys. 24 (2022) 113036] experienced by parallel conducting plates.


title: Effects of Finite Temperature and Pairing Correlations in Multi-$\Lambda$ Hypernuclei

abstract: The influence of finite temperatures and pairing correlations on the ground state properties of multi $\Lambda$- Ca, Sn and Pb hypernuclei is explored using finite temperature Hartree Fock Bogoliubov approach and contact pairing interaction. A critical temperature is predicted and is in agreement with the Bardeen Cooper Schrieffer relationship $k_B T_C^\Lambda \approx 0.5 \Delta^{T=0}_\Lambda$, beyond which pairing correlations drop to zero. Particle densities, $\Lambda$ single particle energies, and nuclear radii are weakly impacted by pairing as well as by finite temperatures. However, other nuclear properties which are more sensitive to pairing correlations, such as $\Lambda$ pairing gaps, condensation energies, and abnormal densities are also more impacted by finite temperature, especially around the critical temperature. Furthermore, calculations show the occurrence of the pairing re-entrance effect in the $^{280}_{70\Lambda}$Pb hyperon drip line hypernucleus. Our study provides insight into the thermal evolution of $\Lambda$ pairing, i.e. the emergence and vanishing of pairing correlations in multi $\Lambda$ hypernuclei as a function of temperature.


title: Evaluating Large Language Models as Generative User Simulators for Conversational Recommendation

abstract: Synthetic users are cost-effective proxies for real users in the evaluation of conversational recommender systems. Large language models show promise in simulating human-like behavior, raising the question of their ability to represent a diverse population of users. We introduce a new protocol to measure the degree to which language models can accurately emulate human behavior in conversational recommendation. This protocol is comprised of five tasks, each designed to evaluate a key property that a synthetic user should exhibit: choosing which items to talk about, expressing binary preferences, expressing open-ended preferences, requesting recommendations, and giving feedback. Through evaluation of baseline simulators, we demonstrate these tasks effectively reveal deviations of language models from human behavior, and offer insights on how to reduce the deviations with model selection and prompting strategies.


title: The Carbon Isotopic Ratio and Planet Formation

abstract: We present the first detection of 13CCH in a protoplanetary disk (TW Hya). Using observations of C2H we measure CCH/13CCH = 65 +/- 20 in gas with a CO isotopic ratio of 12CO/13CO = 21 +/- 5 (Yoshida et al. 2022a). The TW Hya disk exhibits a gas phase C/O that exceeds unity and C2H is the tracer of this excess carbon. We confirm that the TW Hya gaseous disk exhibits two separate carbon isotopic reservoirs as noted previously (Yoshida et al. 2022a). We explore two theoretical solutions for the development of this dichotomy. One model represents TW Hya today with a protoplanetary disk exposed to a cosmic ray ionization rate that is below interstellar as consistent with current estimates. We find that this model does not have sufficient ionization in cold (T < 40 K) layers to activate carbon isotopic fractionation. The second model investigates a younger TW Hya protostellar disk exposed to an interstellar cosmic ray ionization rate. We find that the younger model has sources of ionization deeper in a colder disk that generates two independent isotopic reservoirs. One reservoir is 12C-enriched carried by methane/hydrocarbon ices and the other is 13C-enriched carried by gaseous CO. The former potentially provides a source of methane/hydrocarbon ices to power the chemistry that generates the anomalously strong C$_2$H emission in this (and other) disk systems in later stages. The latter provides a source of gaseous 13C-rich material to generate isotopic enrichments in forming giant planets as recently detected in the super-Jupiter TYC 8998-760-1 b by Zhang et al. (2021).


title: Teaching Machines to Code: Smart Contract Translation with LLMs

abstract: The advent of large language models (LLMs) has marked a significant milestone in the realm of artificial intelligence, with their capabilities often matching or surpassing human expertise in various domains. Among these achievements, their adeptness in translation tasks stands out, closely mimicking the intricate and preliminary processes undertaken by human translators to ensure the fidelity and quality of the translated content. Despite the advancements in utilizing LLMs for translating programming code across different languages, the domain of smart contract translation, particularly into languages not previously encountered by the LLM, remains largely unexplored. In our research, we present a pioneering approach, SolMover, which harnesses the synergy of two distinct LLMs within a unified framework. This framework is designed to grasp coding principles and apply this understanding to the translation of code into an unfamiliar language. Our study delves into the capacity of LLMs to mimic human learning processes, offering an in-depth evaluation of our methodology for converting smart contracts written in Solidity to Move, a language with limited resources. The framework employs one LLM to decipher coding conventions for the new language, creating a blueprint for the second LLM, which, lacking planning abilities, possesses coding expertise. The empirical evidence from our experiments suggests that SolMover substantially enhances performance compared to gpt-3.5-turbo-1106, and achieves superior results over competitors such as Palm2 and Mixtral-8x7B-Instruct. Additionally, our analysis highlights the efficacy of our bug mitigation strategy in elevating code quality across all models, even outside the SolMover framework.


title: A modern approach to String Amplitudes and Intersection Theory

abstract: In this thesis, we study the properties of String theory amplitudes within the framework of Intersection Theory (IT) for twisted (co)homology, which, as recently proposed, offered a novel approach to analyze relations between scattering amplitudes, in string theory as well as in QFT. As only recently pointed out, thanks to IT, the analytic properties of scattering amplitudes can be related to the topological properties of the manifolds characterizing their integral representation. Tree-level string amplitudes, as well as Feynman integrals, obey both linear and quadratic relations governed by intersection numbers, which act as scalar products between vector spaces. We show how (co)homology with values in a local system allows to interpret closed strings tree amplitudes as intersection numbers between twisted cocycles, and open strings tree amplitudes as parings between a twisted cocycle and a twisted cycle. We present different algorithms to evaluate univariate and multivariate intersection numbers between both log and non-log twisted cocycles. We explore a diagrammatic method for the computation of intersection number between twisted cycles of the moduli space of the n-punctured Riemann sphere. We use IT to rederive Kawai-Lewellen-Tye (KLT) relations, naturally emerging as a twisted version of Riemann period relations. We compute intersection matrix between 2D twisted cycles to explicitly obtain the KLT decomposition of five closed tachyons tree amplitudes into partial five open tachyons tree amplitudes. We explicitly determine the intersection matrix between 2D Parke-Taylor (PT) forms. We use a recursive algorithm for generic n cocycle intersection numbers to project tachyon amplitudes integrand into a PT basis, and we apply it to the scattering of four and five tachyons. The methods discussed in the thesis can be broadly applied to problems involving Aomoto-Gelfand integrals.


title: A Short Review on Novel Approaches for Maximum Clique Problem: from Classical algorithms to Graph Neural Networks and Quantum algorithms

abstract: This manuscript provides a comprehensive review of the Maximum Clique Problem, a computational problem that involves finding subsets of vertices in a graph that are all pairwise adjacent to each other. The manuscript covers in a simple way classical algorithms for solving the problem and includes a review of recent developments in graph neural networks and quantum algorithms. The review concludes with benchmarks for testing classical as well as new learning, and quantum algorithms.

categories: cs.AI cond-mat.dis-nn cs.DS cs.LG math.OC quant-ph


title: The Human Factor in Detecting Errors of Large Language Models: A Systematic Literature Review and Future Research Directions

abstract: The launch of ChatGPT by OpenAI in November 2022 marked a pivotal moment for Artificial Intelligence, introducing Large Language Models (LLMs) to the mainstream and setting new records in user adoption. LLMs, particularly ChatGPT, trained on extensive internet data, demonstrate remarkable conversational capabilities across various domains, suggesting a significant impact on the workforce. However, these models are susceptible to errors - "hallucinations" and omissions, generating incorrect or incomplete information. This poses risks especially in contexts where accuracy is crucial, such as legal compliance, medicine or fine-grained process frameworks. There are both technical and human solutions to cope with this isse. This paper explores the human factors that enable users to detect errors in LLM outputs, a critical component in mitigating risks associated with their use in professional settings. Understanding these factors is essential for organizations aiming to leverage LLM technology efficiently, guiding targeted training and deployment strategies to enhance error detection by users. This approach not only aims to optimize the use of LLMs but also to prevent potential downstream issues stemming from reliance on inaccurate model responses. The research emphasizes the balance between technological advancement and human insight in maximizing the benefits of LLMs while minimizing the risks, particularly in areas where precision is paramount. This paper performs a systematic literature research on this research topic, analyses and synthesizes the findings, and outlines future research directions. Literature selection cut-off date is January 11th 2024.


title: Evaluating the Application of Large Language Models to Generate Feedback in Programming Education

abstract: This study investigates the application of large language models, specifically GPT-4, to enhance programming education. The research outlines the design of a web application that uses GPT-4 to provide feedback on programming tasks, without giving away the solution. A web application for working on programming tasks was developed for the study and evaluated with 51 students over the course of one semester. The results show that most of the feedback generated by GPT-4 effectively addressed code errors. However, challenges with incorrect suggestions and hallucinated issues indicate the need for further improvements.


title: Comment on "All-Loop Result for the Strong Magnetic Field Limit of the Heisenberg-Euler Effective Lagrangian"

abstract: We offer a 2nd look at the recently claimed improvement of Euler-Heisenberg-Schwinger (EHS) action [PRL \textbf{122} (2019) no.21, 211602 and post-publication correction]: We demonstrate a difference to the claimed concordance with the Schwinger-Dyson series starting at the two-loop level.


title: PICNIQ: Pairwise Comparisons for Natural Image Quality Assessment

abstract: Blind image quality assessment (BIQA) approaches, while promising for automating image quality evaluation, often fall short in real-world scenarios due to their reliance on a generic quality standard applied uniformly across diverse images. This one-size-fits-all approach overlooks the crucial perceptual relationship between image content and quality, leading to a 'domain shift' challenge where a single quality metric inadequately represents various content types. Furthermore, BIQA techniques typically overlook the inherent differences in the human visual system among different observers. In response to these challenges, this paper introduces PICNIQ, an innovative pairwise comparison framework designed to bypass the limitations of conventional BIQA by emphasizing relative, rather than absolute, quality assessment. PICNIQ is specifically designed to assess the quality differences between image pairs. The proposed framework implements a carefully crafted deep learning architecture, a specialized loss function, and a training strategy optimized for sparse comparison settings. By employing psychometric scaling algorithms like TrueSkill, PICNIQ transforms pairwise comparisons into just-objectionable-difference (JOD) quality scores, offering a granular and interpretable measure of image quality. We conduct our research using comparison matrices from the PIQ23 dataset, which are published in this paper. Our extensive experimental analysis showcases PICNIQ's broad applicability and superior performance over existing models, highlighting its potential to set new standards in the field of BIQA.


title: Re-Search for The Truth: Multi-round Retrieval-augmented Large Language Models are Strong Fake News Detectors

abstract: The proliferation of fake news has had far-reaching implications on politics, the economy, and society at large. While Fake news detection methods have been employed to mitigate this issue, they primarily depend on two essential elements: the quality and relevance of the evidence, and the effectiveness of the verdict prediction mechanism. Traditional methods, which often source information from static repositories like Wikipedia, are limited by outdated or incomplete data, particularly for emerging or rare claims. Large Language Models (LLMs), known for their remarkable reasoning and generative capabilities, introduce a new frontier for fake news detection. However, like traditional methods, LLM-based solutions also grapple with the limitations of stale and long-tail knowledge. Additionally, retrieval-enhanced LLMs frequently struggle with issues such as low-quality evidence retrieval and context length constraints. To address these challenges, we introduce a novel, retrieval-augmented LLMs framework--the first of its kind to automatically and strategically extract key evidence from web sources for claim verification. Employing a multi-round retrieval strategy, our framework ensures the acquisition of sufficient, relevant evidence, thereby enhancing performance. Comprehensive experiments across three real-world datasets validate the framework's superiority over existing methods. Importantly, our model not only delivers accurate verdicts but also offers human-readable explanations to improve result interpretability.


title: Neural Network Analysis of S2-Star Dynamics: Extended mass

abstract: Physics-informed neural network (PINN) analysis of the dynamics of S-stars in the vicinity of the supermassive black hole in the Galactic center is performed within General Relativity treatment. The aim is to reveal the role of possible extended mass (dark matter) configuration in the dynamics of the S-stars, in addition to the dominating central black hole's mass. The PINN training fails to detect the extended mass perturbation in the observational data for S2 star within the existing data accuracy, and the precession constraint indicates no signature of extended mass up to 0.01% of the central mass inside the apocenter of S2. Neural networks analysis thus confirm its efficiency in the analysis of the S-star dynamics.


title: Towards Diverse Perspective Learning with Selection over Multiple Temporal Poolings

abstract: In Time Series Classification (TSC), temporal pooling methods that consider sequential information have been proposed. However, we found that each temporal pooling has a distinct mechanism, and can perform better or worse depending on time series data. We term this fixed pooling mechanism a single perspective of temporal poolings. In this paper, we propose a novel temporal pooling method with diverse perspective learning: Selection over Multiple Temporal Poolings (SoM-TP). SoM-TP dynamically selects the optimal temporal pooling among multiple methods for each data by attention. The dynamic pooling selection is motivated by the ensemble concept of Multiple Choice Learning (MCL), which selects the best among multiple outputs. The pooling selection by SoM-TP's attention enables a non-iterative pooling ensemble within a single classifier. Additionally, we define a perspective loss and Diverse Perspective Learning Network (DPLN). The loss works as a regularizer to reflect all the pooling perspectives from DPLN. Our perspective analysis using Layer-wise Relevance Propagation (LRP) reveals the limitation of a single perspective and ultimately demonstrates diverse perspective learning of SoM-TP. We also show that SoM-TP outperforms CNN models based on other temporal poolings and state-of-the-art models in TSC with extensive UCR/UEA repositories.